[ 522.800766] env[65693]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 522.800766] env[65693]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 523.811363] env[65783]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 523.811363] env[65783]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 525.354891] env[65783]: INFO neutron.common.config [-] Logging enabled! [ 525.355219] env[65783]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 28.0.0.0b2.dev11 [ 525.355435] env[65783]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65783) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 525.355737] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 525.355832] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 525.356677] env[65783]: WARNING oslo_policy.policy [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 525.356882] env[65783]: WARNING oslo_policy.policy [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 525.358591] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] VMware NSXv3 Agent initialized successfully. [ 525.358935] env[65783]: DEBUG oslo_concurrency.lockutils [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] Acquiring lock "singleton_lock" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.359073] env[65783]: DEBUG oslo_concurrency.lockutils [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] Acquired lock "singleton_lock" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.359276] env[65783]: DEBUG oslo_concurrency.lockutils [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] Releasing lock "singleton_lock" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 525.359557] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] Full set of CONF: {{(pid=65783) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 525.359664] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ******************************************************************************** {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 525.359762] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] Configuration options gathered from: {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 525.360111] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 525.360281] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 525.360384] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ================================================================================ {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 525.360548] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] agent_down_time = 75 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.360681] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] allow_automatic_dhcp_failover = True {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.360813] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] allow_bulk = True {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.360952] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] api_extensions_path = {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.361107] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] api_paste_config = api-paste.ini {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.361246] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] auth_strategy = keystone {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.361348] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] backdoor_port = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.361448] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] backdoor_socket = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.361577] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] backlog = 4096 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.361709] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] base_mac = fa:16:3e:00:00:00 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.361864] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] bind_host = 0.0.0.0 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.362007] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] bind_port = 9696 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.362146] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] client_socket_timeout = 900 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.362279] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] config_dir = [] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.362384] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.362517] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] config_source = [] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.362650] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] control_exchange = neutron {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.362783] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] core_plugin = ml2 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.362916] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] debug = True {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.363056] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] default_availability_zones = [] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.363259] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.363394] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] dhcp_agent_notification = True {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.363522] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] dhcp_agents_per_network = 1 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.363647] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] dhcp_lease_duration = 86400 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.363781] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] dhcp_load_type = networks {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.363912] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] dns_domain = openstacklocal {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.364052] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.364184] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] enable_default_route_bfd = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.364310] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] enable_default_route_ecmp = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.364435] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] enable_dvr = True {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.364560] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] enable_new_agents = True {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.364683] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.364805] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] enable_signals = True {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.364928] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] enable_traditional_dhcp = True {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.365057] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] external_dns_driver = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.365185] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] filter_validation = True {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.365319] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] global_physnet_mtu = 8950 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.365446] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] graceful_shutdown_timeout = 60 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.365615] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] host = cpu-1 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.365750] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] host_dvr_for_dhcp = True {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.365878] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] http_retries = 3 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.366029] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] instance_format = [instance: %(uuid)s] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.366167] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.366316] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ipam_driver = internal {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.366455] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ipv6_pd_enabled = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.366581] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] l3_ha = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.366711] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.366839] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] l3_ha_network_physical_name = {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.366966] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] l3_ha_network_type = {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.367110] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] log_color = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.367241] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] log_config_append = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.367371] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.367495] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] log_dir = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.367618] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] log_file = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.367715] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] log_options = True {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.367842] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] log_rotate_interval = 1 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.367974] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] log_rotate_interval_type = days {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.368114] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] log_rotation_type = none {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.368214] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.368311] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.368469] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.368610] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.368710] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.368837] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] max_dns_nameservers = 5 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.368961] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] max_header_line = 16384 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.369096] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] max_l3_agents_per_router = 3 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.369224] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] max_logfile_count = 30 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.369365] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] max_logfile_size_mb = 200 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.369480] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] max_subnet_host_routes = 20 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.369613] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] my_ip = 10.180.1.21 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.369743] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] my_ipv6 = ::1 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.369872] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] network_auto_schedule = True {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.369996] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] network_link_prefix = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.370140] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.370272] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] notify_nova_on_port_data_changes = True {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.370401] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] notify_nova_on_port_status_changes = True {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.370534] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] pagination_max_limit = -1 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.370658] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] publish_errors = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.370780] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] rate_limit_burst = 0 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.370910] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] rate_limit_except_level = CRITICAL {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.371045] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] rate_limit_interval = 0 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.371171] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] retry_until_window = 30 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.371296] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] router_distributed = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.371420] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] rpc_resources_processing_step = 20 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.371545] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] rpc_response_max_timeout = 600 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.371670] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] rpc_response_timeout = 60 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.371792] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] send_events_interval = 2 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.371934] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] service_plugins = ['router'] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.372075] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] setproctitle = on {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.372202] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] shell_completion = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.372334] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] state_path = /opt/stack/data/neutron {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.372473] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] syslog_log_facility = LOG_USER {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.372606] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] tcp_keepidle = 600 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.372737] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] transport_url = **** {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.372863] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] use_journal = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.372989] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] use_json = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.373122] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] use_ssl = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.373244] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] use_stderr = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.373374] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] use_syslog = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.373496] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] vlan_qinq = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.373620] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] vlan_transparent = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.373748] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] watch_log_file = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.373874] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] wsgi_default_pool_size = 100 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.373999] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] wsgi_keep_alive = True {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.374146] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.374273] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] wsgi_server_debug = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 525.374418] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_concurrency.disable_process_locking = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.374562] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.374701] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.374830] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.374965] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.375115] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.375248] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.375391] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] profiler.connection_string = messaging:// {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.375529] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] profiler.enabled = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.375666] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] profiler.es_doc_type = notification {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.375800] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] profiler.es_scroll_size = 10000 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.375935] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] profiler.es_scroll_time = 2m {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.376074] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] profiler.filter_error_trace = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.376209] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] profiler.hmac_keys = **** {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.376382] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] profiler.sentinel_service_name = mymaster {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.376539] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] profiler.socket_timeout = 0.1 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.376672] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] profiler.trace_requests = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.376830] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] profiler.trace_sqlalchemy = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.376980] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] profiler_jaeger.process_tags = {} {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.377124] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] profiler_jaeger.service_name_prefix = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.377256] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] profiler_otlp.service_name_prefix = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.377400] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_policy.enforce_new_defaults = True {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.377672] env[65783]: WARNING oslo_config.cfg [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 525.377819] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_policy.enforce_scope = True {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.377961] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_policy.policy_default_rule = default {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.378117] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.378256] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.378420] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.378561] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.378693] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.378821] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.378948] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.379093] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_policy.remote_timeout = 60.0 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.379238] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.379418] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] agent.extensions = [] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.379537] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.379672] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] service_providers.service_provider = [] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.379808] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] QUOTAS.default_quota = -1 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.379945] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.380084] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] QUOTAS.quota_floatingip = 50 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.380214] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] QUOTAS.quota_network = 100 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.380341] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] QUOTAS.quota_port = 500 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.380501] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.380602] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] QUOTAS.quota_router = 10 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.380727] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] QUOTAS.quota_security_group = 10 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.380853] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.380977] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] QUOTAS.quota_subnet = 100 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.381113] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] QUOTAS.track_quota_usage = True {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.381255] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.381382] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep.group = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.381508] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep.helper_command = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.381634] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep.log_daemon_traceback = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.381765] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.381892] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep.thread_pool_size = 8 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.382026] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep.user = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.382166] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.382290] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_dhcp_release.group = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.382414] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_dhcp_release.helper_command = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.382541] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.382670] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.382799] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.382926] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_dhcp_release.user = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.383071] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.383196] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_ovs_vsctl.group = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.383319] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_ovs_vsctl.helper_command = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.383472] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.383578] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.383713] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.383837] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_ovs_vsctl.user = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.383968] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_namespace.capabilities = [21] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.384103] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_namespace.group = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.384231] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_namespace.helper_command = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.384361] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_namespace.log_daemon_traceback = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.384495] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.384624] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_namespace.thread_pool_size = 8 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.384750] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_namespace.user = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.384885] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_conntrack.capabilities = [12] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.385014] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_conntrack.group = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.385143] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_conntrack.helper_command = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.385274] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.385407] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.385535] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.385658] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_conntrack.user = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.385793] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_link.capabilities = [12, 21] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.385918] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_link.group = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.386049] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_link.helper_command = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.386179] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_link.log_daemon_traceback = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.386325] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.386486] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_link.thread_pool_size = 8 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.386621] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] privsep_link.user = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.386775] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.386919] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.387063] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] AGENT.continue_on_failed_promotions = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.387192] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] AGENT.dscp = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.387325] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] AGENT.dscp_inherit = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.387467] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] AGENT.force_mp_to_policy = True {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.387597] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] AGENT.locking_coordinator_url = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.387729] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] AGENT.log_agent_heartbeats = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.387859] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] AGENT.logging_expire = 1 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.387997] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.388145] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.388286] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] AGENT.polling_interval = 240 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.388447] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.388589] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.388730] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] AGENT.report_interval = 30.0 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.388871] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.389014] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.389156] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.389291] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] AGENT.sync_skew = 60 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.389427] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] AGENT.synchronization_queue_size = 20 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.389562] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] AGENT.use_helper_for_ns_read = True {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.389701] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] SECURITYGROUP.enable_ipset = True {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.389839] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] SECURITYGROUP.enable_security_group = True {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.389975] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.390124] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.390264] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] experimental.ipv6_pd_enabled = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.390419] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ml2.extension_drivers = ['port_security'] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.390551] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ml2.external_network_type = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.390696] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.390833] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ml2.overlay_ip_version = 4 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.390970] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ml2.path_mtu = 8950 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.391120] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ml2.physical_network_mtus = {} {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.391264] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ml2.tenant_network_types = ['vlan'] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.391403] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.391546] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ml2.type_drivers = ['vlan'] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.391687] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] AGENT_CLI.neutron_port_id = [] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.391818] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.391947] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.392099] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.392237] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.392370] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.392505] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.392641] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.392781] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.392977] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.393130] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] NSXV3.nsxv3_login_password = **** {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.393271] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] NSXV3.nsxv3_login_port = 443 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.393406] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] NSXV3.nsxv3_login_user = admin {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.393545] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.393683] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.393816] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.393949] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.394095] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.394236] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.394373] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.394512] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.394644] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.394788] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.394921] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.395061] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.395199] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.395393] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.395538] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] vsphere.vsphere_login_password = VMware1! {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.395675] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.395807] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.395944] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] nova.auth_section = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.396098] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] nova.auth_type = password {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.396236] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.396380] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] nova.certfile = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.396524] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] nova.collect_timing = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.396667] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] nova.endpoint_type = public {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.396799] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] nova.insecure = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.396926] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] nova.keyfile = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.397075] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] nova.region_name = RegionOne {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.397209] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] nova.split_loggers = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.397337] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] nova.timeout = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.397473] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] placement.auth_section = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.397612] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] placement.auth_type = password {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.397747] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.397876] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] placement.certfile = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.398012] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] placement.collect_timing = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.398152] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] placement.endpoint_type = public {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.398281] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] placement.insecure = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.398433] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] placement.keyfile = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.398567] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] placement.region_name = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.398718] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] placement.split_loggers = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.398926] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] placement.timeout = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.399100] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ironic.auth_section = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.399238] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ironic.auth_type = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.399381] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ironic.cafile = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.399523] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ironic.certfile = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.399656] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ironic.collect_timing = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.399782] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ironic.connect_retries = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.399907] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ironic.connect_retry_delay = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.400049] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ironic.enable_notifications = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.400180] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ironic.endpoint_override = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.400311] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ironic.insecure = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.400438] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ironic.interface = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.400564] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ironic.keyfile = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.400693] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ironic.max_version = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.400818] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ironic.min_version = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.400941] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ironic.region_name = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.401077] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ironic.retriable_status_codes = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.401203] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ironic.service_name = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.401327] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ironic.service_type = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.401454] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ironic.split_loggers = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.401579] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ironic.status_code_retries = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.401702] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ironic.status_code_retry_delay = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.401826] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ironic.timeout = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.401949] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ironic.valid_interfaces = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.402081] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ironic.version = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.402215] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] cli_script.dry_run = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.402355] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.402484] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.402612] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.402738] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.402863] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.402989] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.403127] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.403254] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.403381] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.403521] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.403645] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.403781] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.403912] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.404061] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.404195] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.404329] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.404458] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.404588] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.404727] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.404855] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.404984] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.405122] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.405248] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.405372] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.405501] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.405628] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.405756] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.405884] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.406028] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.406144] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.406275] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.ssl = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.406430] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.406577] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.406707] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.406840] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.406973] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.ssl_version = {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.407112] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.407251] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_notifications.driver = [] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.407382] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_notifications.retry = -1 {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.407529] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.407655] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] oslo_messaging_notifications.transport_url = **** {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 525.407754] env[65783]: DEBUG oslo_service.backend._eventlet.service [None req-86482c22-8f60-4628-aac3-fcac7ab27a63 None None] ******************************************************************************** {{(pid=65783) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 525.408945] env[65783]: DEBUG neutron.agent.securitygroups_rpc [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Init firewall settings (driver=nsxv3) {{(pid=65783) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 525.410304] env[65783]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65783) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 525.410549] env[65783]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] RPC agent_id: nsxm-l-01a.corp.local [ 525.412792] env[65783]: DEBUG dogpile.cache.region [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 525.412906] env[65783]: DEBUG dogpile.lock [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 525.413007] env[65783]: DEBUG dogpile.lock [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 525.413101] env[65783]: DEBUG dogpile.lock [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 525.413191] env[65783]: DEBUG dogpile.cache.region [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 525.413277] env[65783]: DEBUG dogpile.lock [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 525.413395] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 525.455972] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Session token - acquiring [ 525.457903] env[65783]: DEBUG networking_nsxv3.common.locking [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.458092] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.458186] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.458657] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 525.471138] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 525.744035] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 525.766404] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 525.766578] env[65783]: DEBUG dogpile.cache.region [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Cache value generated in 0.353 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 525.766676] env[65783]: DEBUG dogpile.lock [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 525.766760] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Activating Policy API Provider. [ 525.766950] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Looking for the default Infrastructure Rules. [ 525.839211] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Looking for the Default Layer3 Logged Drop Section. [ 525.854504] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 525.854976] env[65783]: DEBUG networking_nsxv3.common.locking [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.855160] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Acquiring lock "all" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.855260] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Acquired lock "all" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.855537] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Acquired external semaphore "all" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 525.855869] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 526.370923] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 526.873753] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 527.376284] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Inventory metadata is going to be refreshed. [ 527.376691] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 528.138076] env[65783]: DEBUG networking_nsxv3.common.locking [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.138076] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.138429] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.138526] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.150724] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 528.151666] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.152270] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 528.168662] env[65783]: DEBUG networking_nsxv3.common.locking [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.168940] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.168940] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.169210] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.169327] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.169513] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 528.169616] env[65783]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65783) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 528.169726] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 528.190349] env[65783]: DEBUG networking_nsxv3.common.locking [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.190548] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.190609] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.190882] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.191061] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.191203] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 528.210232] env[65783]: DEBUG networking_nsxv3.common.locking [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.210434] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.210474] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.210745] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.210876] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.211016] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 528.228556] env[65783]: DEBUG networking_nsxv3.common.locking [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.228770] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Acquiring lock "Address Group" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.228843] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Acquired lock "Address Group" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.229133] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Acquired external semaphore "Address Group" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.229269] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Releasing lock "Address Group" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.229469] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 528.229583] env[65783]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65783) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 528.229685] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 528.249382] env[65783]: DEBUG networking_nsxv3.common.locking [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.249610] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Acquiring lock "Segment QoS" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.249662] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Acquired lock "Segment QoS" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.250091] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Acquired external semaphore "Segment QoS" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.250314] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Releasing lock "Segment QoS" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.250468] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 528.250558] env[65783]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65783) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 528.250649] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 528.270828] env[65783]: DEBUG networking_nsxv3.common.locking [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.271030] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.271100] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.271381] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.271518] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.271663] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 528.271764] env[65783]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65783) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 528.271860] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Inventory metadata have been refreshed. [ 528.271955] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Dryrun:True. Metadata refresh completed. [ 528.272072] env[65783]: DEBUG oslo_concurrency.lockutils [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Releasing lock "all" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.273931] env[65783]: INFO neutron.agent.agent_extensions_manager [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Loaded agent extensions: [] [ 528.274714] env[65783]: DEBUG neutron_lib.callbacks.manager [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65783) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 528.330247] env[65783]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] NSXv3 Agent Agent RPC Daemon Started! [ 528.330473] env[65783]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] NSXv3 Agent Agent loop - iteration:0 started [ 528.330473] env[65783]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] NSXv3 Agent Agent out of sync with plugin! [ 533.275173] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 533.275547] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 538.277104] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 538.277498] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 543.216475] env[65783]: INFO networking_nsxv3.common.synchronization [None req-42d753ed-c99f-463e-959f-1a1911a43daf demo admin] Enqueued Resource ID: bb5c1986-6a76-46f6-b963-0b900c5ffecc with Priority: HIGHEST for action security_group_rules [ 543.217036] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb5c1986-6a76-46f6-b963-0b900c5ffecc with Priority: HIGHEST for action security_group_rules [ 543.217344] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb5c1986-6a76-46f6-b963-0b900c5ffecc taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.217472] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb5c1986-6a76-46f6-b963-0b900c5ffecc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.217532] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb5c1986-6a76-46f6-b963-0b900c5ffecc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.217877] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb5c1986-6a76-46f6-b963-0b900c5ffecc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.217962] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb5c1986-6a76-46f6-b963-0b900c5ffecc',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.739947] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.739947] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.739947] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.739947] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.739947] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.739947] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb5c1986-6a76-46f6-b963-0b900c5ffecc already deleted. [ 543.739947] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb5c1986-6a76-46f6-b963-0b900c5ffecc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 548.218391] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 548.218391] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 548.278063] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.278063] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.278063] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 548.278063] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 548.278063] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.780921] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 549.283099] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 549.785402] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 549.785681] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 550.514980] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.515490] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.515490] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.515490] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.527020] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 550.527855] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.528403] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 550.546621] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.546830] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.546830] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.547039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.547125] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.547235] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 550.547304] env[65783]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65783) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 550.547373] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 550.567276] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.567504] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.567504] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.567642] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.567765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.567871] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 550.587953] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.588188] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.588188] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.588358] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.588451] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.588556] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 550.608466] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.608706] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.608706] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.609233] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.609233] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.609233] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 550.609233] env[65783]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65783) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 550.609233] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 550.626834] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.627062] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.627062] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.627250] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.627343] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.627447] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 550.627515] env[65783]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65783) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 550.627584] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 550.646468] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.646672] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.646672] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.646817] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.646917] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.648067] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 550.648067] env[65783]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65783) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 550.648067] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 550.648067] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 550.648067] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 550.648067] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 550.648067] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 550.648067] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 550.648067] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 550.648067] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 550.669856] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.670051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.670051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.670257] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.670353] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.670456] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 550.693405] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.693649] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.693649] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.693800] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.693914] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.708299] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 553.220163] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 553.220163] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 558.220939] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 558.221367] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 563.222300] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 563.222671] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 568.223844] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 568.224181] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 573.228379] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 573.228652] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 575.111244] env[65783]: INFO networking_nsxv3.common.synchronization [None req-46532d54-24f7-4683-8c2d-a66569a360b0 None None] Enqueued Resource ID: 6f889d63-4e94-40e9-9d98-6706955318b2 with Priority: HIGHEST for action port [ 575.111639] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f889d63-4e94-40e9-9d98-6706955318b2 with Priority: HIGHEST for action port [ 575.114043] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f889d63-4e94-40e9-9d98-6706955318b2 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.114043] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f889d63-4e94-40e9-9d98-6706955318b2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.114043] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f889d63-4e94-40e9-9d98-6706955318b2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.114043] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f889d63-4e94-40e9-9d98-6706955318b2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.114043] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f889d63-4e94-40e9-9d98-6706955318b2',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.177024] env[65783]: INFO networking_nsxv3.common.synchronization [None req-44ab50fc-0b48-46c9-b3d3-02f848253e2f None None] Enqueued Resource ID: f4eff0e6-d4da-4d2d-aa2a-cb4d6c257c52 with Priority: HIGHEST for action port [ 575.177559] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4eff0e6-d4da-4d2d-aa2a-cb4d6c257c52 with Priority: HIGHEST for action port [ 575.177993] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4eff0e6-d4da-4d2d-aa2a-cb4d6c257c52 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.178253] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4eff0e6-d4da-4d2d-aa2a-cb4d6c257c52" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.178417] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4eff0e6-d4da-4d2d-aa2a-cb4d6c257c52" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.178724] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4eff0e6-d4da-4d2d-aa2a-cb4d6c257c52" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.179884] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4eff0e6-d4da-4d2d-aa2a-cb4d6c257c52',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.616403] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6f889d63-4e94-40e9-9d98-6706955318b2 [ 575.616663] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.616799] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.616865] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.617456] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.617456] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.617456] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6f889d63-4e94-40e9-9d98-6706955318b2 already deleted. [ 575.617594] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f889d63-4e94-40e9-9d98-6706955318b2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.684187] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f4eff0e6-d4da-4d2d-aa2a-cb4d6c257c52 [ 575.686200] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.686200] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.686200] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.686200] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.686200] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.686200] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f4eff0e6-d4da-4d2d-aa2a-cb4d6c257c52 already deleted. [ 575.686200] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4eff0e6-d4da-4d2d-aa2a-cb4d6c257c52" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.998406] env[65783]: INFO networking_nsxv3.common.synchronization [None req-efb37310-9816-467d-add1-8a42e1c4e968 None None] Enqueued Resource ID: 8c168dd8-adfa-49dd-b477-c03a4b420d09 with Priority: HIGHEST for action port [ 575.998406] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c168dd8-adfa-49dd-b477-c03a4b420d09 with Priority: HIGHEST for action port [ 575.998406] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c168dd8-adfa-49dd-b477-c03a4b420d09 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.998406] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c168dd8-adfa-49dd-b477-c03a4b420d09" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.998406] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c168dd8-adfa-49dd-b477-c03a4b420d09" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.998406] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c168dd8-adfa-49dd-b477-c03a4b420d09" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.998406] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c168dd8-adfa-49dd-b477-c03a4b420d09',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.028665] env[65783]: INFO networking_nsxv3.common.synchronization [None req-00daecdf-bf02-4baf-83f5-14e84e09f838 None None] Enqueued Resource ID: 80b25113-352d-404d-becd-5be7d9ea7324 with Priority: HIGHEST for action port [ 576.028665] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80b25113-352d-404d-becd-5be7d9ea7324 with Priority: HIGHEST for action port [ 576.029808] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-80b25113-352d-404d-becd-5be7d9ea7324 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.029808] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80b25113-352d-404d-becd-5be7d9ea7324" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.029808] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80b25113-352d-404d-becd-5be7d9ea7324" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.029808] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80b25113-352d-404d-becd-5be7d9ea7324" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.029808] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80b25113-352d-404d-becd-5be7d9ea7324',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.505811] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c168dd8-adfa-49dd-b477-c03a4b420d09 [ 576.505811] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.505811] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.505811] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.505811] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.505811] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.505811] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c168dd8-adfa-49dd-b477-c03a4b420d09 already deleted. [ 576.505811] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c168dd8-adfa-49dd-b477-c03a4b420d09" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.531770] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 80b25113-352d-404d-becd-5be7d9ea7324 [ 576.531997] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.532163] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.532266] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.532428] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.532512] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.532599] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:80b25113-352d-404d-becd-5be7d9ea7324 already deleted. [ 576.532674] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80b25113-352d-404d-becd-5be7d9ea7324" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.434646] env[65783]: INFO networking_nsxv3.common.synchronization [None req-ce7d3bd2-1132-402f-8d08-88f332a83acc None None] Enqueued Resource ID: 8674e9c7-5ba8-4581-8139-fd4eca1b7f49 with Priority: HIGHEST for action port [ 577.435084] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8674e9c7-5ba8-4581-8139-fd4eca1b7f49 with Priority: HIGHEST for action port [ 577.435379] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-8674e9c7-5ba8-4581-8139-fd4eca1b7f49 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.435503] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8674e9c7-5ba8-4581-8139-fd4eca1b7f49" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.435602] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8674e9c7-5ba8-4581-8139-fd4eca1b7f49" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.435807] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8674e9c7-5ba8-4581-8139-fd4eca1b7f49" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.435892] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8674e9c7-5ba8-4581-8139-fd4eca1b7f49',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.940665] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8674e9c7-5ba8-4581-8139-fd4eca1b7f49 [ 577.940976] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.941046] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.941100] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.941302] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.941389] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.941597] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8674e9c7-5ba8-4581-8139-fd4eca1b7f49 already deleted. [ 577.941597] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8674e9c7-5ba8-4581-8139-fd4eca1b7f49" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.243515] env[65783]: INFO networking_nsxv3.common.synchronization [None req-7dd59bcc-004e-4188-ab8c-c541cd6b664a None None] Enqueued Resource ID: 69827ac3-4645-42b1-9025-a27a4e985a11 with Priority: HIGHEST for action port [ 578.243782] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69827ac3-4645-42b1-9025-a27a4e985a11 with Priority: HIGHEST for action port [ 578.244388] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-69827ac3-4645-42b1-9025-a27a4e985a11 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.244639] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69827ac3-4645-42b1-9025-a27a4e985a11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.244639] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69827ac3-4645-42b1-9025-a27a4e985a11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.244924] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69827ac3-4645-42b1-9025-a27a4e985a11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.244924] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69827ac3-4645-42b1-9025-a27a4e985a11',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.749910] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 69827ac3-4645-42b1-9025-a27a4e985a11 [ 578.750295] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.751186] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.751186] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.751186] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.751186] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.751186] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:69827ac3-4645-42b1-9025-a27a4e985a11 already deleted. [ 578.751186] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69827ac3-4645-42b1-9025-a27a4e985a11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.990787] env[65783]: INFO networking_nsxv3.common.synchronization [None req-b77d178b-89ba-4a54-aed8-884b657208ea None None] Enqueued Resource ID: c9d99e94-7684-4353-a8b8-f03422c1ee1a with Priority: HIGHEST for action port [ 578.991385] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9d99e94-7684-4353-a8b8-f03422c1ee1a with Priority: HIGHEST for action port [ 578.991853] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9d99e94-7684-4353-a8b8-f03422c1ee1a taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.993110] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9d99e94-7684-4353-a8b8-f03422c1ee1a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.993110] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9d99e94-7684-4353-a8b8-f03422c1ee1a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.993358] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9d99e94-7684-4353-a8b8-f03422c1ee1a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.993659] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9d99e94-7684-4353-a8b8-f03422c1ee1a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.496541] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c9d99e94-7684-4353-a8b8-f03422c1ee1a [ 579.496806] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.496946] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.497067] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.497245] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.497339] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.497432] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c9d99e94-7684-4353-a8b8-f03422c1ee1a already deleted. [ 579.497528] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9d99e94-7684-4353-a8b8-f03422c1ee1a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.414104] env[65783]: INFO networking_nsxv3.common.synchronization [None req-dfb89996-83d9-48a6-a34c-2c65de3668fb None None] Enqueued Resource ID: 48a2ee84-11e5-4779-b344-d7910786adcf with Priority: HIGHEST for action port [ 580.414807] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48a2ee84-11e5-4779-b344-d7910786adcf with Priority: HIGHEST for action port [ 580.415389] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-48a2ee84-11e5-4779-b344-d7910786adcf taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.415519] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48a2ee84-11e5-4779-b344-d7910786adcf" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.415587] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48a2ee84-11e5-4779-b344-d7910786adcf" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.415834] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48a2ee84-11e5-4779-b344-d7910786adcf" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.415914] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48a2ee84-11e5-4779-b344-d7910786adcf',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.918816] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48a2ee84-11e5-4779-b344-d7910786adcf [ 580.919066] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.919941] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.919941] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.919941] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.919941] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.919941] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48a2ee84-11e5-4779-b344-d7910786adcf already deleted. [ 580.919941] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48a2ee84-11e5-4779-b344-d7910786adcf" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.068214] env[65783]: INFO networking_nsxv3.common.synchronization [None req-cc080cfa-4386-4436-bab4-0d193fc2cfb3 None None] Enqueued Resource ID: d31df3c8-c0e1-4e3b-9b5d-6e348ede7a74 with Priority: HIGHEST for action port [ 581.068214] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d31df3c8-c0e1-4e3b-9b5d-6e348ede7a74 with Priority: HIGHEST for action port [ 581.068214] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-d31df3c8-c0e1-4e3b-9b5d-6e348ede7a74 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.068214] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d31df3c8-c0e1-4e3b-9b5d-6e348ede7a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.068214] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d31df3c8-c0e1-4e3b-9b5d-6e348ede7a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.068521] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d31df3c8-c0e1-4e3b-9b5d-6e348ede7a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.068710] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d31df3c8-c0e1-4e3b-9b5d-6e348ede7a74',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.156020] env[65783]: INFO networking_nsxv3.common.synchronization [None req-86f8ca51-6982-4aae-99b7-b2dc1d50e14c None None] Enqueued Resource ID: 42591b2d-7c3c-4381-b798-1ed4a1f25411 with Priority: HIGHEST for action port [ 581.156349] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42591b2d-7c3c-4381-b798-1ed4a1f25411 with Priority: HIGHEST for action port [ 581.157168] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-42591b2d-7c3c-4381-b798-1ed4a1f25411 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.157307] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42591b2d-7c3c-4381-b798-1ed4a1f25411" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.157384] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42591b2d-7c3c-4381-b798-1ed4a1f25411" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.157642] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42591b2d-7c3c-4381-b798-1ed4a1f25411" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.157727] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42591b2d-7c3c-4381-b798-1ed4a1f25411',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.574460] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d31df3c8-c0e1-4e3b-9b5d-6e348ede7a74 [ 581.574728] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.574822] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.574907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.575144] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.575236] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.575339] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d31df3c8-c0e1-4e3b-9b5d-6e348ede7a74 already deleted. [ 581.575405] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d31df3c8-c0e1-4e3b-9b5d-6e348ede7a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.660942] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42591b2d-7c3c-4381-b798-1ed4a1f25411 [ 581.661212] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.661354] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.661427] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.661675] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.662270] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.662270] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42591b2d-7c3c-4381-b798-1ed4a1f25411 already deleted. [ 581.662270] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42591b2d-7c3c-4381-b798-1ed4a1f25411" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.760483] env[65783]: INFO networking_nsxv3.common.synchronization [None req-9d20204a-bc1e-426b-a844-c85b22aa34f3 None None] Enqueued Resource ID: 6ea85f96-45c2-4cf1-bf2a-2a51decc77e1 with Priority: HIGHEST for action port [ 583.760483] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ea85f96-45c2-4cf1-bf2a-2a51decc77e1 with Priority: HIGHEST for action port [ 583.760483] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ea85f96-45c2-4cf1-bf2a-2a51decc77e1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.760483] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ea85f96-45c2-4cf1-bf2a-2a51decc77e1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.760483] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ea85f96-45c2-4cf1-bf2a-2a51decc77e1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.761380] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ea85f96-45c2-4cf1-bf2a-2a51decc77e1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.761659] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ea85f96-45c2-4cf1-bf2a-2a51decc77e1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.188206] env[65783]: INFO networking_nsxv3.common.synchronization [None req-83412c8a-ae59-4ca2-a63f-c954ca6cce88 None None] Enqueued Resource ID: d5855d45-e966-4966-8207-09d4c75e1725 with Priority: HIGHEST for action port [ 584.188603] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5855d45-e966-4966-8207-09d4c75e1725 with Priority: HIGHEST for action port [ 584.188789] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5855d45-e966-4966-8207-09d4c75e1725 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.188911] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5855d45-e966-4966-8207-09d4c75e1725" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.188972] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5855d45-e966-4966-8207-09d4c75e1725" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.189434] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5855d45-e966-4966-8207-09d4c75e1725" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.189690] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5855d45-e966-4966-8207-09d4c75e1725',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.264400] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ea85f96-45c2-4cf1-bf2a-2a51decc77e1 [ 584.264597] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.264738] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.265013] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.265084] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.265126] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.267021] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ea85f96-45c2-4cf1-bf2a-2a51decc77e1 already deleted. [ 584.267021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ea85f96-45c2-4cf1-bf2a-2a51decc77e1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.326703] env[65783]: INFO networking_nsxv3.common.synchronization [None req-20119d1a-911f-42e0-a40e-7ead078e1cd2 None None] Enqueued Resource ID: 4eccc2b9-1e54-4d8a-b6ca-4595eb10c098 with Priority: HIGHEST for action port [ 584.326965] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eccc2b9-1e54-4d8a-b6ca-4595eb10c098 with Priority: HIGHEST for action port [ 584.327583] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-4eccc2b9-1e54-4d8a-b6ca-4595eb10c098 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.327721] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4eccc2b9-1e54-4d8a-b6ca-4595eb10c098" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.327814] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4eccc2b9-1e54-4d8a-b6ca-4595eb10c098" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.328303] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4eccc2b9-1e54-4d8a-b6ca-4595eb10c098" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.328395] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4eccc2b9-1e54-4d8a-b6ca-4595eb10c098',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.692894] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d5855d45-e966-4966-8207-09d4c75e1725 [ 584.693222] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.693326] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.693409] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.693654] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.693746] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.693954] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d5855d45-e966-4966-8207-09d4c75e1725 already deleted. [ 584.693954] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5855d45-e966-4966-8207-09d4c75e1725" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.830676] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4eccc2b9-1e54-4d8a-b6ca-4595eb10c098 [ 584.830973] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.831072] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.831120] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.831381] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.831440] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.831484] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4eccc2b9-1e54-4d8a-b6ca-4595eb10c098 already deleted. [ 584.831543] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4eccc2b9-1e54-4d8a-b6ca-4595eb10c098" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.995022] env[65783]: INFO networking_nsxv3.common.synchronization [None req-b4b788ec-ed9f-4881-9050-16a3eb46b5ba None None] Enqueued Resource ID: c928dc3c-b0da-483e-babe-2967aa63b3b1 with Priority: HIGHEST for action port [ 584.995307] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c928dc3c-b0da-483e-babe-2967aa63b3b1 with Priority: HIGHEST for action port [ 584.996024] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-c928dc3c-b0da-483e-babe-2967aa63b3b1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.996024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c928dc3c-b0da-483e-babe-2967aa63b3b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.996127] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c928dc3c-b0da-483e-babe-2967aa63b3b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.996307] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c928dc3c-b0da-483e-babe-2967aa63b3b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.996383] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c928dc3c-b0da-483e-babe-2967aa63b3b1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.499139] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c928dc3c-b0da-483e-babe-2967aa63b3b1 [ 585.499472] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.499619] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.499689] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.499903] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.499991] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.500095] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c928dc3c-b0da-483e-babe-2967aa63b3b1 already deleted. [ 585.500180] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c928dc3c-b0da-483e-babe-2967aa63b3b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.451800] env[65783]: INFO networking_nsxv3.common.synchronization [None req-969cf5b6-517d-414f-b14c-670a99cbc6ec None None] Enqueued Resource ID: 7ecc1af8-6f62-41d5-9c08-ea5ae84bef88 with Priority: HIGHEST for action port [ 586.452844] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ecc1af8-6f62-41d5-9c08-ea5ae84bef88 with Priority: HIGHEST for action port [ 586.453165] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ecc1af8-6f62-41d5-9c08-ea5ae84bef88 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.453297] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ecc1af8-6f62-41d5-9c08-ea5ae84bef88" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.453366] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ecc1af8-6f62-41d5-9c08-ea5ae84bef88" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.453685] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ecc1af8-6f62-41d5-9c08-ea5ae84bef88" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.453829] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ecc1af8-6f62-41d5-9c08-ea5ae84bef88',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.742383] env[65783]: INFO networking_nsxv3.common.synchronization [None req-bd9e4184-59a4-4c1b-9494-56c4a0601efa None None] Enqueued Resource ID: 61bf542f-1ddd-4d7b-8663-e8102f2b621a with Priority: HIGHEST for action port [ 586.742383] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61bf542f-1ddd-4d7b-8663-e8102f2b621a with Priority: HIGHEST for action port [ 586.742599] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-61bf542f-1ddd-4d7b-8663-e8102f2b621a taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.742599] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61bf542f-1ddd-4d7b-8663-e8102f2b621a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.742694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61bf542f-1ddd-4d7b-8663-e8102f2b621a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.743122] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61bf542f-1ddd-4d7b-8663-e8102f2b621a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.743122] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61bf542f-1ddd-4d7b-8663-e8102f2b621a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.958661] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ecc1af8-6f62-41d5-9c08-ea5ae84bef88 [ 586.958888] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.959029] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.959097] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.959348] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.959450] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.959536] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ecc1af8-6f62-41d5-9c08-ea5ae84bef88 already deleted. [ 586.959613] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ecc1af8-6f62-41d5-9c08-ea5ae84bef88" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.247535] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 61bf542f-1ddd-4d7b-8663-e8102f2b621a [ 587.247535] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.247535] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.247535] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.247535] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.247535] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.247535] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:61bf542f-1ddd-4d7b-8663-e8102f2b621a already deleted. [ 587.247535] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61bf542f-1ddd-4d7b-8663-e8102f2b621a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.500517] env[65783]: INFO networking_nsxv3.common.synchronization [req-1b5b7b3d-f65e-46b6-bf9e-d74db68cc840 req-5f0dd913-6cfa-4ad2-be6f-e47aee76efa7 tempest-DeleteServersAdminTestJSON-1691143419 tempest-DeleteServersAdminTestJSON-1691143419-project-member] Enqueued Resource ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 with Priority: HIGHEST for action security_group_members [ 587.500782] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 with Priority: HIGHEST for action security_group_members [ 587.502831] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.503094] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.503229] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.503505] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.503778] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.503890] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.504098] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.504285] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.504370] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.504462] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.009044] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.009587] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.009668] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.010031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.010130] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.010375] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.010493] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.010557] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.010713] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.011709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.011831] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 already deleted. [ 588.011941] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.104417] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-251 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.104632] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.104756] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.105699] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.105699] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.105866] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.105992] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.106278] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.106715] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.107551] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 588.107921] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 588.107921] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 588.108116] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 588.108258] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 588.109196] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 588.109196] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 588.128754] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 588.128862] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 588.128943] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 588.129137] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.129504] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-4dd6a49e-86fd-442c-bd8d-4acf8587707f taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.129679] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-4dd6a49e-86fd-442c-bd8d-4acf8587707f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.130464] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-4dd6a49e-86fd-442c-bd8d-4acf8587707f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.130738] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-4dd6a49e-86fd-442c-bd8d-4acf8587707f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.131156] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4dd6a49e-86fd-442c-bd8d-4acf8587707f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.220040] env[65783]: INFO networking_nsxv3.common.synchronization [None req-449c7bb9-7a01-4a2f-afce-5eb4a840112a None None] Enqueued Resource ID: 5c6e5515-097d-4630-830e-72099c9726e6 with Priority: HIGHEST for action port [ 588.220040] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c6e5515-097d-4630-830e-72099c9726e6 with Priority: HIGHEST for action port [ 588.220040] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c6e5515-097d-4630-830e-72099c9726e6 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.220040] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c6e5515-097d-4630-830e-72099c9726e6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.220040] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c6e5515-097d-4630-830e-72099c9726e6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.220040] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c6e5515-097d-4630-830e-72099c9726e6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.220040] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c6e5515-097d-4630-830e-72099c9726e6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.633636] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.634021] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.634021] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.634240] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.634831] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.634831] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 4dd6a49e-86fd-442c-bd8d-4acf8587707f not found, creating... [ 588.634831] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.635087] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.635087] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.635247] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.635374] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.635718] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.635872] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.636008] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.636191] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.636320] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.636451] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 4dd6a49e-86fd-442c-bd8d-4acf8587707f is going to be created. [ 588.665043] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.666940] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.666940] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.666940] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.666940] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.666940] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-4dd6a49e-86fd-442c-bd8d-4acf8587707f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.723795] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5c6e5515-097d-4630-830e-72099c9726e6 [ 588.724119] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.724119] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.724119] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.724377] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.724377] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.724789] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5c6e5515-097d-4630-830e-72099c9726e6 already deleted. [ 588.724789] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c6e5515-097d-4630-830e-72099c9726e6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.192140] env[65783]: INFO networking_nsxv3.common.synchronization [req-9063bf26-fdd4-44b3-994a-7b6acac00eb4 req-1eb634c5-fdef-4585-900f-0fc836b4968f tempest-MigrationsAdminTest-1412758904 tempest-MigrationsAdminTest-1412758904-project-member] Enqueued Resource ID: b6e66254-5e43-437b-850b-825eaaa0cee1 with Priority: HIGHEST for action security_group_members [ 589.192523] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e66254-5e43-437b-850b-825eaaa0cee1 with Priority: HIGHEST for action security_group_members [ 589.192789] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e66254-5e43-437b-850b-825eaaa0cee1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.192910] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.192976] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.194749] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.196522] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.196659] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.196731] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.196911] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.197007] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.197112] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6e66254-5e43-437b-850b-825eaaa0cee1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.284124] env[65783]: INFO networking_nsxv3.common.synchronization [req-eb3a1e65-3c66-4b2d-bd4e-13b90c63b02f req-70dbed2a-cba3-4186-9230-0c20cb5318ef tempest-SecurityGroupRulesNegativeTestJSON-534089917 tempest-SecurityGroupRulesNegativeTestJSON-534089917-project-member] Enqueued Resource ID: 5abc724d-ee46-4a5c-a04f-e170ddbafc5f with Priority: HIGHEST for action security_group_rules [ 589.285689] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5abc724d-ee46-4a5c-a04f-e170ddbafc5f with Priority: HIGHEST for action security_group_rules [ 589.289030] env[65783]: INFO networking_nsxv3.common.synchronization [None req-197caf7e-5c05-406d-87dc-2c1abdca4c95 None None] Enqueued Resource ID: 845c9bf5-14d7-49e5-b68c-c3797791ae45 with Priority: HIGHEST for action port [ 589.289030] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5abc724d-ee46-4a5c-a04f-e170ddbafc5f taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.289030] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5abc724d-ee46-4a5c-a04f-e170ddbafc5f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.289030] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5abc724d-ee46-4a5c-a04f-e170ddbafc5f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.289030] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5abc724d-ee46-4a5c-a04f-e170ddbafc5f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.296021] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5abc724d-ee46-4a5c-a04f-e170ddbafc5f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.296021] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 845c9bf5-14d7-49e5-b68c-c3797791ae45 with Priority: HIGHEST for action port [ 589.296021] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-845c9bf5-14d7-49e5-b68c-c3797791ae45 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.296021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-845c9bf5-14d7-49e5-b68c-c3797791ae45" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.296021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-845c9bf5-14d7-49e5-b68c-c3797791ae45" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.296021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-845c9bf5-14d7-49e5-b68c-c3797791ae45" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.296021] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('845c9bf5-14d7-49e5-b68c-c3797791ae45',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.507173] env[65783]: INFO networking_nsxv3.common.synchronization [req-1b5b7b3d-f65e-46b6-bf9e-d74db68cc840 req-7b7d95d3-1237-4a40-9c44-125805a57e2f service nova] Enqueued Resource ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 with Priority: HIGHEST for action security_group_rules [ 589.507173] env[65783]: INFO networking_nsxv3.common.synchronization [req-1b5b7b3d-f65e-46b6-bf9e-d74db68cc840 req-7b7d95d3-1237-4a40-9c44-125805a57e2f service nova] Enqueued Resource ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 with Priority: HIGHEST for action security_group_members [ 589.507173] env[65783]: INFO networking_nsxv3.common.synchronization [req-1b5b7b3d-f65e-46b6-bf9e-d74db68cc840 req-7b7d95d3-1237-4a40-9c44-125805a57e2f service nova] Enqueued Resource ID: 4dd6a49e-86fd-442c-bd8d-4acf8587707f with Priority: HIGHEST for action port [ 589.507173] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 with Priority: HIGHEST for action security_group_rules [ 589.507173] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 with Priority: HIGHEST for action security_group_members [ 589.507173] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd6a49e-86fd-442c-bd8d-4acf8587707f with Priority: HIGHEST for action port [ 589.507662] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.511021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.511021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.511021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.511021] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.511021] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.511021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.511021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.511021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.511021] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.511021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.511021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.511021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.511021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.511021] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.511021] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-4dd6a49e-86fd-442c-bd8d-4acf8587707f taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.511021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4dd6a49e-86fd-442c-bd8d-4acf8587707f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.512103] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4dd6a49e-86fd-442c-bd8d-4acf8587707f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.512103] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4dd6a49e-86fd-442c-bd8d-4acf8587707f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.512103] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4dd6a49e-86fd-442c-bd8d-4acf8587707f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.699412] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.699730] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.699730] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.699801] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.700765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.700765] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.700765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.700765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.700765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.700765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.700765] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6e66254-5e43-437b-850b-825eaaa0cee1 already deleted. [ 589.700765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.808660] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 845c9bf5-14d7-49e5-b68c-c3797791ae45 [ 589.809159] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.809407] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.810167] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.810167] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.810167] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.810167] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:845c9bf5-14d7-49e5-b68c-c3797791ae45 already deleted. [ 589.810167] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-845c9bf5-14d7-49e5-b68c-c3797791ae45" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.819862] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.819995] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.820186] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.820417] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.820546] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.820789] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5abc724d-ee46-4a5c-a04f-e170ddbafc5f already deleted. [ 589.820824] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5abc724d-ee46-4a5c-a04f-e170ddbafc5f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.877163] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-251 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.877163] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.877163] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.877163] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.877163] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.877473] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.879415] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.879714] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.879909] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.880778] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 589.880936] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 589.881090] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 589.881212] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 589.881347] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 589.881472] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 589.881618] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 589.902899] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 589.903088] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 589.903226] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 589.904659] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.904989] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-ffa53d50-ad0e-438c-994a-b0b7a97f85f2 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.905185] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-ffa53d50-ad0e-438c-994a-b0b7a97f85f2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.905302] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-ffa53d50-ad0e-438c-994a-b0b7a97f85f2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.905620] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-ffa53d50-ad0e-438c-994a-b0b7a97f85f2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.905790] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffa53d50-ad0e-438c-994a-b0b7a97f85f2',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.015781] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.015973] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.016111] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.025665] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4dd6a49e-86fd-442c-bd8d-4acf8587707f with status ACTIVE [ 590.025900] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.026138] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.026549] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.026549] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.026649] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.026834] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.026933] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.026995] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.027326] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.027425] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.027854] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.027956] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.028375] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.028375] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.028375] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.028375] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4dd6a49e-86fd-442c-bd8d-4acf8587707f is going to be updated. [ 590.051656] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.052530] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.052530] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.052530] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.052530] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.052530] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4dd6a49e-86fd-442c-bd8d-4acf8587707f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.135989] env[65783]: INFO networking_nsxv3.common.synchronization [None req-bea27963-f562-41bc-b307-d57705f0e203 tempest-ServerActionsTestOtherA-298845163 tempest-ServerActionsTestOtherA-298845163-project-member] Enqueued Resource ID: aaf15510-666a-49d9-9a20-6f398b7f8216 with Priority: HIGHEST for action security_group_rules [ 590.136566] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaf15510-666a-49d9-9a20-6f398b7f8216 with Priority: HIGHEST for action security_group_rules [ 590.136867] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aaf15510-666a-49d9-9a20-6f398b7f8216 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.137010] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.137843] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.137843] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.137843] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aaf15510-666a-49d9-9a20-6f398b7f8216',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.228061] env[65783]: INFO networking_nsxv3.common.synchronization [None req-2e236127-7103-4578-b910-fe8484e527a0 tempest-ServerActionsTestOtherB-29394606 tempest-ServerActionsTestOtherB-29394606-project-member] Enqueued Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_rules [ 590.228668] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_rules [ 590.228876] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c81f8cb-609b-4496-9f07-b80abbe519f8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.229049] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.229084] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.229339] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.229394] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.313338] env[65783]: INFO networking_nsxv3.common.synchronization [None req-50273489-07ae-4e16-aed1-42ea19e23937 tempest-ServerActionsTestOtherA-298845163 tempest-ServerActionsTestOtherA-298845163-project-member] Enqueued Resource ID: aaf15510-666a-49d9-9a20-6f398b7f8216 with Priority: HIGHEST for action security_group_rules [ 590.313918] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaf15510-666a-49d9-9a20-6f398b7f8216 with Priority: HIGHEST for action security_group_rules [ 590.315139] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aaf15510-666a-49d9-9a20-6f398b7f8216 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.315251] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.402255] env[65783]: INFO networking_nsxv3.common.synchronization [None req-3f130333-589f-41d3-adb6-a16ae6faccb3 tempest-ServerActionsTestOtherB-29394606 tempest-ServerActionsTestOtherB-29394606-project-member] Enqueued Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_rules [ 590.403419] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_rules [ 590.403419] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c81f8cb-609b-4496-9f07-b80abbe519f8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.403419] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.412220] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.412220] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.412220] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.412220] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.412220] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.412220] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port ffa53d50-ad0e-438c-994a-b0b7a97f85f2 not found, creating... [ 590.412220] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.412220] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.412220] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.412220] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.412220] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.412644] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.412644] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.412644] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.412644] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.412644] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.412644] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: ffa53d50-ad0e-438c-994a-b0b7a97f85f2 is going to be created. [ 590.433646] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.433646] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.433646] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.433646] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.433646] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.433863] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-ffa53d50-ad0e-438c-994a-b0b7a97f85f2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.519937] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.584835] env[65783]: INFO networking_nsxv3.common.synchronization [None req-9fa3059f-a59d-4faf-90d3-72c6cc393bd4 None None] Enqueued Resource ID: 0b8b5079-6c18-43e9-86f6-c70c08383475 with Priority: HIGHEST for action port [ 590.584835] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b8b5079-6c18-43e9-86f6-c70c08383475 with Priority: HIGHEST for action port [ 590.584979] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b8b5079-6c18-43e9-86f6-c70c08383475 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.585079] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b8b5079-6c18-43e9-86f6-c70c08383475" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.585349] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b8b5079-6c18-43e9-86f6-c70c08383475" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.585680] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b8b5079-6c18-43e9-86f6-c70c08383475" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.585680] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b8b5079-6c18-43e9-86f6-c70c08383475',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.662770] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.663296] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.663507] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.663771] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.664908] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.665041] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aaf15510-666a-49d9-9a20-6f398b7f8216 already deleted. [ 590.665142] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.665684] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.665884] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.665969] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aaf15510-666a-49d9-9a20-6f398b7f8216',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.750734] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.751145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.751145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.751145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.751271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.751326] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 already deleted. [ 590.751410] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.751554] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.751705] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.751786] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.023059] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.023190] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.023266] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.023509] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.023552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.023706] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 is going to be created. [ 591.055954] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.055954] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.055954] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.055954] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.055954] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.065589] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 in Status: UNINITIALIZED for 2s [ 591.087088] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0b8b5079-6c18-43e9-86f6-c70c08383475 [ 591.087370] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.087595] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.087629] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.087821] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.087909] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.088000] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0b8b5079-6c18-43e9-86f6-c70c08383475 already deleted. [ 591.088111] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b8b5079-6c18-43e9-86f6-c70c08383475" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.107316] env[65783]: INFO networking_nsxv3.common.synchronization [req-9063bf26-fdd4-44b3-994a-7b6acac00eb4 req-9bc64566-86a2-4af9-850c-ab312c9c1835 service nova] Enqueued Resource ID: b6e66254-5e43-437b-850b-825eaaa0cee1 with Priority: HIGHEST for action security_group_rules [ 591.112984] env[65783]: INFO networking_nsxv3.common.synchronization [req-9063bf26-fdd4-44b3-994a-7b6acac00eb4 req-9bc64566-86a2-4af9-850c-ab312c9c1835 service nova] Enqueued Resource ID: b6e66254-5e43-437b-850b-825eaaa0cee1 with Priority: HIGHEST for action security_group_members [ 591.112984] env[65783]: INFO networking_nsxv3.common.synchronization [req-9063bf26-fdd4-44b3-994a-7b6acac00eb4 req-9bc64566-86a2-4af9-850c-ab312c9c1835 service nova] Enqueued Resource ID: ffa53d50-ad0e-438c-994a-b0b7a97f85f2 with Priority: HIGHEST for action port [ 591.112984] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e66254-5e43-437b-850b-825eaaa0cee1 with Priority: HIGHEST for action security_group_rules [ 591.112984] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e66254-5e43-437b-850b-825eaaa0cee1 with Priority: HIGHEST for action security_group_members [ 591.112984] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffa53d50-ad0e-438c-994a-b0b7a97f85f2 with Priority: HIGHEST for action port [ 591.112984] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6e66254-5e43-437b-850b-825eaaa0cee1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.112984] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.112984] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.112984] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.112984] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6e66254-5e43-437b-850b-825eaaa0cee1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.113598] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e66254-5e43-437b-850b-825eaaa0cee1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.113598] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.113769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.113836] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.114022] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.114119] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.114178] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.114324] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.114428] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.114566] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6e66254-5e43-437b-850b-825eaaa0cee1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.115449] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffa53d50-ad0e-438c-994a-b0b7a97f85f2 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.115551] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffa53d50-ad0e-438c-994a-b0b7a97f85f2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.115612] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffa53d50-ad0e-438c-994a-b0b7a97f85f2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.115757] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffa53d50-ad0e-438c-994a-b0b7a97f85f2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.115873] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffa53d50-ad0e-438c-994a-b0b7a97f85f2',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.186684] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.186832] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.186954] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.187121] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.187227] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.187775] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aaf15510-666a-49d9-9a20-6f398b7f8216 already deleted. [ 591.187883] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.278329] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.278994] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.278994] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.278994] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.278994] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.279168] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 already deleted. [ 591.279168] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.618232] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e66254-5e43-437b-850b-825eaaa0cee1 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.618232] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.618450] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b6e66254-5e43-437b-850b-825eaaa0cee1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.621423] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ffa53d50-ad0e-438c-994a-b0b7a97f85f2 with status ACTIVE [ 591.621677] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.621811] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.621883] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.622075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.622160] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.622918] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.622918] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.622918] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.622918] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.622918] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.622918] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.623202] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.623202] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.624318] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.624318] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.624318] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ffa53d50-ad0e-438c-994a-b0b7a97f85f2 is going to be updated. [ 591.649390] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.649390] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.649390] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.649390] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.649390] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.649390] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffa53d50-ad0e-438c-994a-b0b7a97f85f2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.127346] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b6e66254-5e43-437b-850b-825eaaa0cee1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.142147] env[65783]: INFO networking_nsxv3.common.synchronization [None req-669e03eb-24ea-46c2-9198-614a168314d9 tempest-VolumesAssistedSnapshotsTest-1577585050 tempest-VolumesAssistedSnapshotsTest-1577585050-project-member] Enqueued Resource ID: 527a6015-4311-4050-9945-7b4c6e602f59 with Priority: HIGHEST for action security_group_rules [ 592.142147] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527a6015-4311-4050-9945-7b4c6e602f59 with Priority: HIGHEST for action security_group_rules [ 592.142147] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-527a6015-4311-4050-9945-7b4c6e602f59 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.142147] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.142147] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.142147] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.142147] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('527a6015-4311-4050-9945-7b4c6e602f59',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.220143] env[65783]: INFO networking_nsxv3.common.synchronization [None req-14869513-67fe-4b62-b6f2-304b99d62987 None None] Enqueued Resource ID: b32ddca1-1656-403c-acf7-38d87274ad28 with Priority: HIGHEST for action port [ 592.220347] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b32ddca1-1656-403c-acf7-38d87274ad28 with Priority: HIGHEST for action port [ 592.221026] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-b32ddca1-1656-403c-acf7-38d87274ad28 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.221026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b32ddca1-1656-403c-acf7-38d87274ad28" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.223010] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b32ddca1-1656-403c-acf7-38d87274ad28" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.223010] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b32ddca1-1656-403c-acf7-38d87274ad28" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.223010] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b32ddca1-1656-403c-acf7-38d87274ad28',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.629751] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.630222] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.630441] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.630815] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.632148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.632379] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6e66254-5e43-437b-850b-825eaaa0cee1 is going to be created. [ 592.657840] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.658141] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.658141] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.658860] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.658860] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.671420] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6e66254-5e43-437b-850b-825eaaa0cee1 in Status: UNINITIALIZED for 2s [ 592.675767] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.675936] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.675981] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.676268] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.676386] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.676507] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 527a6015-4311-4050-9945-7b4c6e602f59 already deleted. [ 592.677558] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.726452] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b32ddca1-1656-403c-acf7-38d87274ad28 [ 592.727082] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.727082] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.727082] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.727482] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.727482] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.727482] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b32ddca1-1656-403c-acf7-38d87274ad28 already deleted. [ 592.727482] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b32ddca1-1656-403c-acf7-38d87274ad28" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.750817] env[65783]: INFO networking_nsxv3.common.synchronization [None req-92fd18c0-6ce0-4613-b9b5-f5e1ef2980a3 tempest-VolumesAssistedSnapshotsTest-1577585050 tempest-VolumesAssistedSnapshotsTest-1577585050-project-member] Enqueued Resource ID: 527a6015-4311-4050-9945-7b4c6e602f59 with Priority: HIGHEST for action security_group_rules [ 592.750817] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527a6015-4311-4050-9945-7b4c6e602f59 with Priority: HIGHEST for action security_group_rules [ 592.751032] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-527a6015-4311-4050-9945-7b4c6e602f59 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.751234] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.751234] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.751403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.751529] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('527a6015-4311-4050-9945-7b4c6e602f59',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.766439] env[65783]: INFO networking_nsxv3.common.synchronization [None req-2ffb6e53-cbae-4233-be5d-06d5b1e6225a None None] Enqueued Resource ID: d896b304-57f1-40f5-9abd-c6768dc460ec with Priority: HIGHEST for action port [ 592.766895] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d896b304-57f1-40f5-9abd-c6768dc460ec with Priority: HIGHEST for action port [ 592.767618] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-d896b304-57f1-40f5-9abd-c6768dc460ec taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.767852] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d896b304-57f1-40f5-9abd-c6768dc460ec" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.767990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d896b304-57f1-40f5-9abd-c6768dc460ec" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.768186] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d896b304-57f1-40f5-9abd-c6768dc460ec" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.768271] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d896b304-57f1-40f5-9abd-c6768dc460ec',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.076306] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 in Status: SUCCESS [ 593.076877] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.077184] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.077541] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.077907] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.078307] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.079419] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.079419] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.079520] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.079805] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.079805] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.178929] env[65783]: INFO networking_nsxv3.common.synchronization [None req-4c10be44-a4aa-437e-93ed-d8d641f91973 None None] Enqueued Resource ID: 551a3450-8db9-451f-b6d3-ba09cd045e1f with Priority: HIGHEST for action port [ 593.179508] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 551a3450-8db9-451f-b6d3-ba09cd045e1f with Priority: HIGHEST for action port [ 593.179805] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-551a3450-8db9-451f-b6d3-ba09cd045e1f taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.180030] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-551a3450-8db9-451f-b6d3-ba09cd045e1f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.180030] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-551a3450-8db9-451f-b6d3-ba09cd045e1f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.180738] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-551a3450-8db9-451f-b6d3-ba09cd045e1f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.180738] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('551a3450-8db9-451f-b6d3-ba09cd045e1f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.271902] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d896b304-57f1-40f5-9abd-c6768dc460ec [ 593.272159] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.272297] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.272398] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.272559] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.273257] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.273257] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d896b304-57f1-40f5-9abd-c6768dc460ec already deleted. [ 593.273257] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d896b304-57f1-40f5-9abd-c6768dc460ec" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.282439] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.282439] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.282633] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.283544] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.283544] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.283544] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 527a6015-4311-4050-9945-7b4c6e602f59 already deleted. [ 593.283544] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.585087] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.585269] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.585345] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.585548] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.587369] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.589014] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.589167] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.589585] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.589585] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.589691] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.589771] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.589876] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.589941] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.590105] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.590252] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.590347] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.590409] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.590548] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.590618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.590698] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.590787] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.683085] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 551a3450-8db9-451f-b6d3-ba09cd045e1f [ 593.683284] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.683458] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.683572] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.683758] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.683956] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.683956] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:551a3450-8db9-451f-b6d3-ba09cd045e1f already deleted. [ 593.684170] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-551a3450-8db9-451f-b6d3-ba09cd045e1f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.094516] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47: rpc.has_security_group_logging(os_id): False [ 594.117194] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.117350] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.117422] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.117642] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.117732] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.117928] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.118063] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.118101] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.118237] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.118310] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.118507] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.118601] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.118662] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.118800] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.118873] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.119070] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.119155] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.119206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.119378] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.119434] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.119517] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 is going to be created. [ 594.183024] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.183024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.183024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.183024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.183024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.189280] env[65783]: INFO networking_nsxv3.common.synchronization [req-0a1eb16f-62db-4775-9ca3-42a7204f6609 req-11cab360-1a85-479e-9526-e710b496d457 tempest-ServerDiagnosticsTest-1881811713 tempest-ServerDiagnosticsTest-1881811713-project-member] Enqueued Resource ID: 0c4389af-195b-4eda-a15f-a441817ee12a with Priority: HIGHEST for action security_group_members [ 594.189280] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4389af-195b-4eda-a15f-a441817ee12a with Priority: HIGHEST for action security_group_members [ 594.189280] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4389af-195b-4eda-a15f-a441817ee12a taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.189280] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.189280] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.192777] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.192777] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.192777] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.192777] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.192777] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.192777] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.192777] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4389af-195b-4eda-a15f-a441817ee12a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.194170] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 in Status: IN_PROGRESS for 2s [ 594.607576] env[65783]: INFO networking_nsxv3.common.synchronization [None req-35230c19-a05f-45a4-9245-6f84ec8a164f None None] Enqueued Resource ID: 836233b9-0761-4fc9-95a9-d6b5cd1e107f with Priority: HIGHEST for action port [ 594.609320] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 836233b9-0761-4fc9-95a9-d6b5cd1e107f with Priority: HIGHEST for action port [ 594.610457] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-836233b9-0761-4fc9-95a9-d6b5cd1e107f taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.610578] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-836233b9-0761-4fc9-95a9-d6b5cd1e107f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.610643] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-836233b9-0761-4fc9-95a9-d6b5cd1e107f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.610902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-836233b9-0761-4fc9-95a9-d6b5cd1e107f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.610981] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('836233b9-0761-4fc9-95a9-d6b5cd1e107f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.683186] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6e66254-5e43-437b-850b-825eaaa0cee1 in Status: SUCCESS [ 594.683506] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.683506] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.683738] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.684115] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.684115] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.684565] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.684565] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.684565] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.684565] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.684689] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b6e66254-5e43-437b-850b-825eaaa0cee1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.693895] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.696245] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.696430] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.696696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.696743] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.697036] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.697126] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.700646] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.700646] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.700646] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.700646] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4389af-195b-4eda-a15f-a441817ee12a already deleted. [ 594.700646] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.738589] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-251 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.738826] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.738949] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.739269] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.739569] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.739718] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.739856] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.740097] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.740234] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.740656] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 594.740656] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 594.740656] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 594.740829] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 594.740896] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 594.740991] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 594.741091] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 594.761027] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 594.761599] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 594.761599] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 594.761746] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.762097] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-5cc1dfe1-7bda-4f6a-9828-254a5f93a508 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.762453] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-5cc1dfe1-7bda-4f6a-9828-254a5f93a508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.762453] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-5cc1dfe1-7bda-4f6a-9828-254a5f93a508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.762749] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-5cc1dfe1-7bda-4f6a-9828-254a5f93a508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.762878] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cc1dfe1-7bda-4f6a-9828-254a5f93a508',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.113871] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 836233b9-0761-4fc9-95a9-d6b5cd1e107f [ 595.114194] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.114482] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.114482] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.115135] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.115135] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.115135] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:836233b9-0761-4fc9-95a9-d6b5cd1e107f already deleted. [ 595.115135] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-836233b9-0761-4fc9-95a9-d6b5cd1e107f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.187638] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e66254-5e43-437b-850b-825eaaa0cee1 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.187949] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.187949] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.188093] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.189231] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.189231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.189231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.189231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.189231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.189231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.189231] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e66254-5e43-437b-850b-825eaaa0cee1 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.189231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.189231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.189231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.189946] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.189946] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.189946] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.189946] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.189946] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.189946] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.189946] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b6e66254-5e43-437b-850b-825eaaa0cee1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.267033] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.267033] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.267033] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.267033] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.267033] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.267033] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 5cc1dfe1-7bda-4f6a-9828-254a5f93a508 not found, creating... [ 595.267033] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.267033] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.267660] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.267816] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.267979] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.268327] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.268520] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.268736] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.269069] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.269237] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.269469] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 5cc1dfe1-7bda-4f6a-9828-254a5f93a508 is going to be created. [ 595.293501] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.293787] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.293907] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.294266] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.294417] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.294638] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-5cc1dfe1-7bda-4f6a-9828-254a5f93a508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.410324] env[65783]: INFO networking_nsxv3.common.synchronization [req-add46046-fd98-4562-b2b1-bb437499fe61 req-6d2679ec-6819-40c8-a630-0aa5f548884f tempest-ImagesNegativeTestJSON-2006960124 tempest-ImagesNegativeTestJSON-2006960124-project-member] Enqueued Resource ID: dd42c762-b73d-4959-95b1-e671bccc381e with Priority: HIGHEST for action security_group_members [ 595.413761] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd42c762-b73d-4959-95b1-e671bccc381e with Priority: HIGHEST for action security_group_members [ 595.416523] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd42c762-b73d-4959-95b1-e671bccc381e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.416523] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.416523] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.416523] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.416523] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.416523] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.416523] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.416523] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.416523] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.416867] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd42c762-b73d-4959-95b1-e671bccc381e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.692854] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b6e66254-5e43-437b-850b-825eaaa0cee1: rpc.has_security_group_logging(os_id): False [ 595.716165] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.716374] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.716374] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.716597] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.716690] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.716879] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.716988] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.717053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.717199] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.717289] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.717492] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.717580] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.717639] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.717779] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.717850] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.718047] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.718138] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.718197] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.718335] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.718403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.718484] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6e66254-5e43-437b-850b-825eaaa0cee1 is going to be created. [ 595.797772] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.797929] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.798009] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.798770] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.798770] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.810881] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6e66254-5e43-437b-850b-825eaaa0cee1 in Status: IN_PROGRESS for 2s [ 595.920274] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.920427] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.921902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.921902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.921902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.921902] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.921902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.921902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.921902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.921902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.921902] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd42c762-b73d-4959-95b1-e671bccc381e already deleted. [ 595.921902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.039227] env[65783]: INFO networking_nsxv3.common.synchronization [req-0a1eb16f-62db-4775-9ca3-42a7204f6609 req-c91d5d8c-c0a3-4214-811d-2ddba9528b81 service nova] Enqueued Resource ID: 0c4389af-195b-4eda-a15f-a441817ee12a with Priority: HIGHEST for action security_group_rules [ 596.039227] env[65783]: INFO networking_nsxv3.common.synchronization [req-0a1eb16f-62db-4775-9ca3-42a7204f6609 req-c91d5d8c-c0a3-4214-811d-2ddba9528b81 service nova] Enqueued Resource ID: 0c4389af-195b-4eda-a15f-a441817ee12a with Priority: HIGHEST for action security_group_members [ 596.039695] env[65783]: INFO networking_nsxv3.common.synchronization [req-0a1eb16f-62db-4775-9ca3-42a7204f6609 req-c91d5d8c-c0a3-4214-811d-2ddba9528b81 service nova] Enqueued Resource ID: 5cc1dfe1-7bda-4f6a-9828-254a5f93a508 with Priority: HIGHEST for action port [ 596.040933] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4389af-195b-4eda-a15f-a441817ee12a with Priority: HIGHEST for action security_group_rules [ 596.041530] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4389af-195b-4eda-a15f-a441817ee12a with Priority: HIGHEST for action security_group_members [ 596.041769] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cc1dfe1-7bda-4f6a-9828-254a5f93a508 with Priority: HIGHEST for action port [ 596.042395] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c4389af-195b-4eda-a15f-a441817ee12a taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.044022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.044022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.044022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.044022] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c4389af-195b-4eda-a15f-a441817ee12a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.046016] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4389af-195b-4eda-a15f-a441817ee12a taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.047902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.047902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.047902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.047902] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.047902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.047902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.047902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.047902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.047902] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4389af-195b-4eda-a15f-a441817ee12a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.053739] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cc1dfe1-7bda-4f6a-9828-254a5f93a508 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.053739] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cc1dfe1-7bda-4f6a-9828-254a5f93a508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.053739] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cc1dfe1-7bda-4f6a-9828-254a5f93a508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.053739] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cc1dfe1-7bda-4f6a-9828-254a5f93a508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.053739] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cc1dfe1-7bda-4f6a-9828-254a5f93a508',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.189810] env[65783]: INFO networking_nsxv3.common.synchronization [None req-21d2af6d-5b82-43b1-a5f4-26a8ca3b7605 None None] Enqueued Resource ID: a1dca0b6-fa8c-4f72-8894-7a76028b75b5 with Priority: HIGHEST for action port [ 596.189810] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1dca0b6-fa8c-4f72-8894-7a76028b75b5 with Priority: HIGHEST for action port [ 596.190413] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1dca0b6-fa8c-4f72-8894-7a76028b75b5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.190413] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1dca0b6-fa8c-4f72-8894-7a76028b75b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.190413] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1dca0b6-fa8c-4f72-8894-7a76028b75b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.190413] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1dca0b6-fa8c-4f72-8894-7a76028b75b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.190413] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1dca0b6-fa8c-4f72-8894-7a76028b75b5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.212092] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 in Status: SUCCESS [ 596.212361] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.215920] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-273 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.215920] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-273" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.215920] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-273" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.216153] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-273" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.216229] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.216389] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.216503] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.216788] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.216855] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.217056] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 596.217167] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 596.217289] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 596.217426] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 596.217550] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 596.217695] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 596.218550] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 596.237228] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 596.237437] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 596.237574] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 596.237743] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-273" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.238055] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-752afe50-54ab-4302-9e95-0147367eacf8 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.238412] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-752afe50-54ab-4302-9e95-0147367eacf8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.238576] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-752afe50-54ab-4302-9e95-0147367eacf8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.238885] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-752afe50-54ab-4302-9e95-0147367eacf8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.239033] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('752afe50-54ab-4302-9e95-0147367eacf8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.553722] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c4389af-195b-4eda-a15f-a441817ee12a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.555457] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5cc1dfe1-7bda-4f6a-9828-254a5f93a508 with status ACTIVE [ 596.555671] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.555804] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.555863] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.556082] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.556163] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.556402] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.556489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.556657] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.556857] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.556936] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.557179] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.557302] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.557407] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.557546] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.557611] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.557658] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5cc1dfe1-7bda-4f6a-9828-254a5f93a508 is going to be updated. [ 596.558733] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4389af-195b-4eda-a15f-a441817ee12a taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.558883] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.579800] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.579992] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.579992] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.580209] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.580388] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.580506] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cc1dfe1-7bda-4f6a-9828-254a5f93a508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.692382] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a1dca0b6-fa8c-4f72-8894-7a76028b75b5 [ 596.692634] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.692777] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.692853] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.693050] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.693142] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.693241] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a1dca0b6-fa8c-4f72-8894-7a76028b75b5 already deleted. [ 596.693328] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1dca0b6-fa8c-4f72-8894-7a76028b75b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.741166] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.741706] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.741863] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.742154] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.742296] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.742441] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 752afe50-54ab-4302-9e95-0147367eacf8 not found, creating... [ 596.742689] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.742845] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.742955] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.743177] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.743306] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.743643] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.743794] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.743903] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.744117] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.744256] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.744388] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 752afe50-54ab-4302-9e95-0147367eacf8 is going to be created. [ 596.767935] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.768300] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.768300] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.768495] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.768707] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.768915] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-752afe50-54ab-4302-9e95-0147367eacf8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.055572] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c4389af-195b-4eda-a15f-a441817ee12a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.558915] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.559235] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.559235] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.559624] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.559624] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.559694] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4389af-195b-4eda-a15f-a441817ee12a is going to be created. [ 597.586025] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.586025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.586025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.586025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.586025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.598321] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4389af-195b-4eda-a15f-a441817ee12a in Status: UNINITIALIZED for 2s [ 597.830819] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6e66254-5e43-437b-850b-825eaaa0cee1 in Status: SUCCESS [ 597.830819] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.923463] env[65783]: INFO networking_nsxv3.common.synchronization [req-add46046-fd98-4562-b2b1-bb437499fe61 req-b10f6a00-4c64-43f8-bb94-1634d7ee3bf3 service nova] Enqueued Resource ID: dd42c762-b73d-4959-95b1-e671bccc381e with Priority: HIGHEST for action security_group_rules [ 597.923463] env[65783]: INFO networking_nsxv3.common.synchronization [req-add46046-fd98-4562-b2b1-bb437499fe61 req-b10f6a00-4c64-43f8-bb94-1634d7ee3bf3 service nova] Enqueued Resource ID: dd42c762-b73d-4959-95b1-e671bccc381e with Priority: HIGHEST for action security_group_members [ 597.923463] env[65783]: INFO networking_nsxv3.common.synchronization [req-add46046-fd98-4562-b2b1-bb437499fe61 req-b10f6a00-4c64-43f8-bb94-1634d7ee3bf3 service nova] Enqueued Resource ID: 752afe50-54ab-4302-9e95-0147367eacf8 with Priority: HIGHEST for action port [ 597.923463] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd42c762-b73d-4959-95b1-e671bccc381e with Priority: HIGHEST for action security_group_rules [ 597.925400] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd42c762-b73d-4959-95b1-e671bccc381e with Priority: HIGHEST for action security_group_members [ 597.925400] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 752afe50-54ab-4302-9e95-0147367eacf8 with Priority: HIGHEST for action port [ 597.925400] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd42c762-b73d-4959-95b1-e671bccc381e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.925400] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.925400] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.925400] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.925400] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd42c762-b73d-4959-95b1-e671bccc381e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.926686] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd42c762-b73d-4959-95b1-e671bccc381e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.926823] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.926867] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.927057] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.927250] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.930122] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.930122] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.930122] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.930122] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.930122] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd42c762-b73d-4959-95b1-e671bccc381e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.930122] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-752afe50-54ab-4302-9e95-0147367eacf8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.930122] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-752afe50-54ab-4302-9e95-0147367eacf8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.930122] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-752afe50-54ab-4302-9e95-0147367eacf8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.930122] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-752afe50-54ab-4302-9e95-0147367eacf8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.930122] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('752afe50-54ab-4302-9e95-0147367eacf8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.113907] env[65783]: INFO networking_nsxv3.common.synchronization [None req-a8f2c52f-ad20-46ff-97dd-c76330193dd6 None None] Enqueued Resource ID: f898f3bf-5465-4097-9c79-8221fcb54e29 with Priority: HIGHEST for action port [ 598.114498] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f898f3bf-5465-4097-9c79-8221fcb54e29 with Priority: HIGHEST for action port [ 598.114808] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-f898f3bf-5465-4097-9c79-8221fcb54e29 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.114933] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f898f3bf-5465-4097-9c79-8221fcb54e29" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.116008] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f898f3bf-5465-4097-9c79-8221fcb54e29" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.116377] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f898f3bf-5465-4097-9c79-8221fcb54e29" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.116508] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f898f3bf-5465-4097-9c79-8221fcb54e29',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.251274] env[65783]: INFO networking_nsxv3.common.synchronization [req-a668de77-f262-4a2e-bf22-2fb95290b005 req-00a7633f-5f9d-4fd5-98b9-aafd0a727418 tempest-SecurityGroupRulesNegativeTestJSON-534089917 tempest-SecurityGroupRulesNegativeTestJSON-534089917-project-member] Enqueued Resource ID: 5abc724d-ee46-4a5c-a04f-e170ddbafc5f with Priority: HIGHEST for action security_group_rules [ 598.251678] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5abc724d-ee46-4a5c-a04f-e170ddbafc5f with Priority: HIGHEST for action security_group_rules [ 598.251999] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5abc724d-ee46-4a5c-a04f-e170ddbafc5f taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.252279] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5abc724d-ee46-4a5c-a04f-e170ddbafc5f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.252279] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5abc724d-ee46-4a5c-a04f-e170ddbafc5f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.252405] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5abc724d-ee46-4a5c-a04f-e170ddbafc5f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.252485] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5abc724d-ee46-4a5c-a04f-e170ddbafc5f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.314981] env[65783]: INFO networking_nsxv3.common.synchronization [req-8aa0df7b-4b70-46d1-a6d7-555c9f93019d req-1088c5f7-c584-489c-a493-098d58156fb3 tempest-ServerExternalEventsTest-1308199313 tempest-ServerExternalEventsTest-1308199313-project-member] Enqueued Resource ID: 85cfbc91-333d-4a17-874c-c9f26dffaadd with Priority: HIGHEST for action security_group_members [ 598.314981] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cfbc91-333d-4a17-874c-c9f26dffaadd with Priority: HIGHEST for action security_group_members [ 598.315079] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cfbc91-333d-4a17-874c-c9f26dffaadd taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.315255] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.315255] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.315523] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.315678] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.315854] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.315854] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.317735] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.317735] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.317735] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85cfbc91-333d-4a17-874c-c9f26dffaadd',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.433566] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 752afe50-54ab-4302-9e95-0147367eacf8 with status ACTIVE [ 598.434420] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.434420] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.434420] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.434420] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.434420] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.434640] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.434640] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.434721] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.435026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.435026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.435160] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.435160] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.435237] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.435634] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.435634] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.435634] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 752afe50-54ab-4302-9e95-0147367eacf8 is going to be updated. [ 598.436661] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd42c762-b73d-4959-95b1-e671bccc381e taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.436767] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.437943] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd42c762-b73d-4959-95b1-e671bccc381e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.460733] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.460863] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.460918] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.461114] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.461248] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.461398] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-752afe50-54ab-4302-9e95-0147367eacf8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.604524] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-251 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.604883] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.604883] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.605114] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.605269] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.605454] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.605590] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.605803] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.605943] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.606157] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 598.606267] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 598.606372] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 598.606478] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 598.606582] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 598.606683] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 598.606808] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 598.620124] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f898f3bf-5465-4097-9c79-8221fcb54e29 [ 598.620124] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.620124] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.620124] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.620124] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.620559] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.620559] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f898f3bf-5465-4097-9c79-8221fcb54e29 already deleted. [ 598.620559] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f898f3bf-5465-4097-9c79-8221fcb54e29" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.626894] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 598.627101] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 598.627259] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 598.627454] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.627926] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-a0bbf2f7-7442-4457-a3e7-eba29d08da68 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.628164] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-a0bbf2f7-7442-4457-a3e7-eba29d08da68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.628313] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-a0bbf2f7-7442-4457-a3e7-eba29d08da68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.628573] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-a0bbf2f7-7442-4457-a3e7-eba29d08da68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.628705] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0bbf2f7-7442-4457-a3e7-eba29d08da68',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.777329] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.777700] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.777700] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.777803] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.777846] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.777981] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5abc724d-ee46-4a5c-a04f-e170ddbafc5f already deleted. [ 598.777981] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5abc724d-ee46-4a5c-a04f-e170ddbafc5f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.823719] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.823719] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.823719] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.823987] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.823987] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.824187] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.824291] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.824353] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.824566] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.824566] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.824725] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cfbc91-333d-4a17-874c-c9f26dffaadd already deleted. [ 598.824725] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.942167] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd42c762-b73d-4959-95b1-e671bccc381e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.133739] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.133739] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.133739] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.133739] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.133739] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.133739] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port a0bbf2f7-7442-4457-a3e7-eba29d08da68 not found, creating... [ 599.133739] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.133739] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.133739] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.133739] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.133739] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.134485] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.134707] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.134865] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.135130] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.135814] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.135814] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: a0bbf2f7-7442-4457-a3e7-eba29d08da68 is going to be created. [ 599.157989] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.158273] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.158457] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.158676] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.159283] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.159283] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-a0bbf2f7-7442-4457-a3e7-eba29d08da68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.450785] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.450785] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.450785] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.450785] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.450785] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.450785] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd42c762-b73d-4959-95b1-e671bccc381e is going to be created. [ 599.478166] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.479093] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.479564] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.479894] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.480329] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.495771] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd42c762-b73d-4959-95b1-e671bccc381e in Status: UNINITIALIZED for 2s [ 599.610153] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4389af-195b-4eda-a15f-a441817ee12a in Status: SUCCESS [ 599.610440] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.612092] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.612340] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.612580] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.612707] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.612770] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.612942] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.613904] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.614085] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.614884] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c4389af-195b-4eda-a15f-a441817ee12a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.949197] env[65783]: INFO networking_nsxv3.common.synchronization [req-8aa0df7b-4b70-46d1-a6d7-555c9f93019d req-ed743980-083a-4a7e-8c44-bd11dff402e0 service nova] Enqueued Resource ID: 85cfbc91-333d-4a17-874c-c9f26dffaadd with Priority: HIGHEST for action security_group_rules [ 599.949369] env[65783]: INFO networking_nsxv3.common.synchronization [req-8aa0df7b-4b70-46d1-a6d7-555c9f93019d req-ed743980-083a-4a7e-8c44-bd11dff402e0 service nova] Enqueued Resource ID: 85cfbc91-333d-4a17-874c-c9f26dffaadd with Priority: HIGHEST for action security_group_members [ 599.949643] env[65783]: INFO networking_nsxv3.common.synchronization [req-8aa0df7b-4b70-46d1-a6d7-555c9f93019d req-ed743980-083a-4a7e-8c44-bd11dff402e0 service nova] Enqueued Resource ID: a0bbf2f7-7442-4457-a3e7-eba29d08da68 with Priority: HIGHEST for action port [ 599.950064] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cfbc91-333d-4a17-874c-c9f26dffaadd with Priority: HIGHEST for action security_group_rules [ 599.950199] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cfbc91-333d-4a17-874c-c9f26dffaadd with Priority: HIGHEST for action security_group_members [ 599.950291] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0bbf2f7-7442-4457-a3e7-eba29d08da68 with Priority: HIGHEST for action port [ 599.950567] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85cfbc91-333d-4a17-874c-c9f26dffaadd taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.950697] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.950762] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.951029] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.951116] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85cfbc91-333d-4a17-874c-c9f26dffaadd',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.951948] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cfbc91-333d-4a17-874c-c9f26dffaadd taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.952076] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.952143] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.952305] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.952446] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.952545] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.952625] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.952797] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.952880] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.952967] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85cfbc91-333d-4a17-874c-c9f26dffaadd',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.953693] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0bbf2f7-7442-4457-a3e7-eba29d08da68 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.953799] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0bbf2f7-7442-4457-a3e7-eba29d08da68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.953865] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0bbf2f7-7442-4457-a3e7-eba29d08da68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.954014] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0bbf2f7-7442-4457-a3e7-eba29d08da68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.954884] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0bbf2f7-7442-4457-a3e7-eba29d08da68',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.116986] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4389af-195b-4eda-a15f-a441817ee12a taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.117612] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.117612] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.117612] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.117834] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.117942] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.118011] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.118171] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.118259] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.118429] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.118475] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4389af-195b-4eda-a15f-a441817ee12a taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.118571] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.118635] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.118807] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.118949] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.119054] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.119128] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.119309] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.119408] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.119525] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.119619] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c4389af-195b-4eda-a15f-a441817ee12a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.390892] env[65783]: INFO networking_nsxv3.common.synchronization [None req-6c68a1f3-3b2c-433c-a1ed-83878a371962 None None] Enqueued Resource ID: 428c2363-46a2-477f-8813-945cd0d25cef with Priority: HIGHEST for action port [ 600.391204] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 428c2363-46a2-477f-8813-945cd0d25cef with Priority: HIGHEST for action port [ 600.391510] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-428c2363-46a2-477f-8813-945cd0d25cef taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.391645] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-428c2363-46a2-477f-8813-945cd0d25cef" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.391744] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-428c2363-46a2-477f-8813-945cd0d25cef" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.391985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-428c2363-46a2-477f-8813-945cd0d25cef" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.392211] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('428c2363-46a2-477f-8813-945cd0d25cef',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.457656] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a0bbf2f7-7442-4457-a3e7-eba29d08da68 with status ACTIVE [ 600.457887] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.457999] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.458160] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.458377] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.458377] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.458569] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.458673] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.458720] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.458869] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.458941] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.459131] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.459243] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.459316] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.459489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.459572] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.459679] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a0bbf2f7-7442-4457-a3e7-eba29d08da68 is going to be updated. [ 600.460949] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cfbc91-333d-4a17-874c-c9f26dffaadd taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.462081] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.462201] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85cfbc91-333d-4a17-874c-c9f26dffaadd',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.493410] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.493410] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.493410] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.493410] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.493410] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.493410] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0bbf2f7-7442-4457-a3e7-eba29d08da68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.622400] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c4389af-195b-4eda-a15f-a441817ee12a: rpc.has_security_group_logging(os_id): False [ 600.644255] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.644422] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.644472] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.644718] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.644924] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.645080] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.645171] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.645171] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.645736] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.645736] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.645736] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.645736] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.645736] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.646137] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.646137] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.646137] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.649175] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.649175] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.649175] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.649175] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.649175] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c4389af-195b-4eda-a15f-a441817ee12a is going to be created. [ 600.732673] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.732935] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.732935] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.733229] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.733434] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.752850] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c4389af-195b-4eda-a15f-a441817ee12a in Status: IN_PROGRESS for 2s [ 600.895876] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 428c2363-46a2-477f-8813-945cd0d25cef [ 600.896108] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.896253] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.896323] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.896552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.896660] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.896729] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:428c2363-46a2-477f-8813-945cd0d25cef already deleted. [ 600.896803] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-428c2363-46a2-477f-8813-945cd0d25cef" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.969050] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85cfbc91-333d-4a17-874c-c9f26dffaadd',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.475143] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.475143] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.475143] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.475143] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.475143] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.475143] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cfbc91-333d-4a17-874c-c9f26dffaadd is going to be created. [ 601.502413] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.502559] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.502627] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.502836] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.503010] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.513923] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd42c762-b73d-4959-95b1-e671bccc381e in Status: SUCCESS [ 601.514153] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.514980] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.514980] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.514980] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.514980] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.514980] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.515210] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.515210] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.515272] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.515323] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd42c762-b73d-4959-95b1-e671bccc381e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.516832] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cfbc91-333d-4a17-874c-c9f26dffaadd in Status: UNINITIALIZED for 2s [ 602.018800] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd42c762-b73d-4959-95b1-e671bccc381e taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.018800] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.018800] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.019224] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.019224] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.019224] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.019353] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.019579] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.019693] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.019784] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.019955] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd42c762-b73d-4959-95b1-e671bccc381e taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.020068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.020129] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.020296] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.020465] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.020564] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.020819] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.020819] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.020819] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.020944] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.020996] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd42c762-b73d-4959-95b1-e671bccc381e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.525638] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd42c762-b73d-4959-95b1-e671bccc381e: rpc.has_security_group_logging(os_id): False [ 602.555056] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.555711] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.555711] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.555711] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.555711] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.555877] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.555931] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.555965] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.556147] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.556207] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.556426] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.556511] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.556511] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.556646] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.556720] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.556886] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.556979] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.558154] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.558349] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.558436] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.558533] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd42c762-b73d-4959-95b1-e671bccc381e is going to be created. [ 602.648708] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.648878] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.648956] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.649300] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.649472] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.664138] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd42c762-b73d-4959-95b1-e671bccc381e in Status: IN_PROGRESS for 2s [ 602.771672] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c4389af-195b-4eda-a15f-a441817ee12a in Status: SUCCESS [ 602.771899] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.531712] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cfbc91-333d-4a17-874c-c9f26dffaadd in Status: SUCCESS [ 603.532021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.532189] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.532473] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.532527] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.532654] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.532687] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.532812] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.532889] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.533222] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.533222] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85cfbc91-333d-4a17-874c-c9f26dffaadd',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.809754] env[65783]: INFO networking_nsxv3.common.synchronization [req-87d50ff6-e30b-4d5d-a224-5efae959aefd req-676a0e48-9e25-4f6c-ac8b-25e20b058b3d tempest-ServerDiskConfigTestJSON-664757069 tempest-ServerDiskConfigTestJSON-664757069-project-member] Enqueued Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 603.809754] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 603.809754] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.809754] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.809754] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.809754] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.810057] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.810239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.810369] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.810640] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.810803] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.811027] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.035650] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cfbc91-333d-4a17-874c-c9f26dffaadd taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.035813] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.035883] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.038543] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.038807] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.038936] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.039000] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.039999] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.039999] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.039999] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.039999] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cfbc91-333d-4a17-874c-c9f26dffaadd taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.039999] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.039999] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.039999] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.040346] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.040346] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.040346] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.040346] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.040520] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.040520] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.040605] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85cfbc91-333d-4a17-874c-c9f26dffaadd',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.314147] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.314519] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.314519] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.314740] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.314813] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.315065] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.315200] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.315297] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.315428] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.315521] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.315664] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 already deleted. [ 604.315752] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.544927] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85cfbc91-333d-4a17-874c-c9f26dffaadd: rpc.has_security_group_logging(os_id): False [ 604.567396] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.567396] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.567396] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.567396] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.567396] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.567396] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.567396] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.567396] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.567396] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.567396] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.567396] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.567396] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.567396] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.567396] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.567396] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.568010] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.568010] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.568010] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.568010] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.568010] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.568010] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85cfbc91-333d-4a17-874c-c9f26dffaadd is going to be created. [ 604.637230] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.637392] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.637461] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.637715] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.637861] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.648959] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85cfbc91-333d-4a17-874c-c9f26dffaadd in Status: IN_PROGRESS for 2s [ 604.685786] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd42c762-b73d-4959-95b1-e671bccc381e in Status: SUCCESS [ 604.686179] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.834763] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-965 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.835386] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-965" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.835386] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-965" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.835712] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-965" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.836263] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.836359] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.836478] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.836701] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.836913] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.837217] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 604.837299] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 604.837487] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 604.837676] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 604.837823] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 604.837935] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 604.838073] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 604.858840] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 604.859053] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 604.859166] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 604.859349] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-965" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.859862] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-d564449f-c908-4d2b-9416-3ea9d3d371fc taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.860168] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-d564449f-c908-4d2b-9416-3ea9d3d371fc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.860308] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-d564449f-c908-4d2b-9416-3ea9d3d371fc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.860752] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-d564449f-c908-4d2b-9416-3ea9d3d371fc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.860896] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d564449f-c908-4d2b-9416-3ea9d3d371fc',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.364181] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.364650] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.364793] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.365031] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.365982] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.365982] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port d564449f-c908-4d2b-9416-3ea9d3d371fc not found, creating... [ 605.365982] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.365982] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.365982] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.366325] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.366403] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.366727] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.366955] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.367142] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.367397] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.367559] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.367728] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: d564449f-c908-4d2b-9416-3ea9d3d371fc is going to be created. [ 605.391041] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.391041] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.391041] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.391285] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.391392] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.391537] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-d564449f-c908-4d2b-9416-3ea9d3d371fc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.113047] env[65783]: INFO networking_nsxv3.common.synchronization [req-87d50ff6-e30b-4d5d-a224-5efae959aefd req-ed16dfab-4b3a-4cea-96fc-2d3cf4a9f064 service nova] Enqueued Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_rules [ 606.113540] env[65783]: INFO networking_nsxv3.common.synchronization [req-87d50ff6-e30b-4d5d-a224-5efae959aefd req-ed16dfab-4b3a-4cea-96fc-2d3cf4a9f064 service nova] Enqueued Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 606.113540] env[65783]: INFO networking_nsxv3.common.synchronization [req-87d50ff6-e30b-4d5d-a224-5efae959aefd req-ed16dfab-4b3a-4cea-96fc-2d3cf4a9f064 service nova] Enqueued Resource ID: d564449f-c908-4d2b-9416-3ea9d3d371fc with Priority: HIGHEST for action port [ 606.113625] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_rules [ 606.113765] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 606.113878] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d564449f-c908-4d2b-9416-3ea9d3d371fc with Priority: HIGHEST for action port [ 606.114442] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.114561] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.114671] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.114875] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.114964] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.116283] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.116403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.116489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.116626] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.116752] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.117039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.117039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.117039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.117182] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.117221] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.118032] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-d564449f-c908-4d2b-9416-3ea9d3d371fc taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.118032] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d564449f-c908-4d2b-9416-3ea9d3d371fc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.118166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d564449f-c908-4d2b-9416-3ea9d3d371fc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.119555] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d564449f-c908-4d2b-9416-3ea9d3d371fc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.119555] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d564449f-c908-4d2b-9416-3ea9d3d371fc',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.621983] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.622575] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.622575] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.623253] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d564449f-c908-4d2b-9416-3ea9d3d371fc with status ACTIVE [ 606.624223] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.624223] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.624223] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.624223] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.624223] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.624223] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.624223] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.624223] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.624672] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.624672] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.624672] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.624672] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.624808] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.624842] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.624913] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.625452] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d564449f-c908-4d2b-9416-3ea9d3d371fc is going to be updated. [ 606.649532] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.649721] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.649721] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.649946] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.650109] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.650275] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d564449f-c908-4d2b-9416-3ea9d3d371fc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.662623] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85cfbc91-333d-4a17-874c-c9f26dffaadd in Status: SUCCESS [ 606.662849] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.992170] env[65783]: INFO networking_nsxv3.common.synchronization [None req-d7b53bf3-08bb-475c-ac8e-b78916dcfe91 None None] Enqueued Resource ID: cf2aeae6-2e89-4b39-a4fd-53a4f909fe07 with Priority: HIGHEST for action port [ 606.992170] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf2aeae6-2e89-4b39-a4fd-53a4f909fe07 with Priority: HIGHEST for action port [ 606.992170] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf2aeae6-2e89-4b39-a4fd-53a4f909fe07 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.992170] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf2aeae6-2e89-4b39-a4fd-53a4f909fe07" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.992170] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf2aeae6-2e89-4b39-a4fd-53a4f909fe07" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.992780] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf2aeae6-2e89-4b39-a4fd-53a4f909fe07" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.993038] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf2aeae6-2e89-4b39-a4fd-53a4f909fe07',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.127564] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.334663] env[65783]: INFO networking_nsxv3.common.synchronization [None req-0b720ace-5045-4438-921a-5b5c49d3f6e3 tempest-ServersWithSpecificFlavorTestJSON-767212478 tempest-ServersWithSpecificFlavorTestJSON-767212478-project-member] Enqueued Resource ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 with Priority: HIGHEST for action security_group_rules [ 607.335919] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 with Priority: HIGHEST for action security_group_rules [ 607.336694] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e588ff7c-d45a-4b75-823e-f219eeb5e814 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.336890] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.336987] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.337441] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.337593] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e588ff7c-d45a-4b75-823e-f219eeb5e814',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.496738] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf2aeae6-2e89-4b39-a4fd-53a4f909fe07 [ 607.496895] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.497113] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.497190] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.499909] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.499909] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.499909] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf2aeae6-2e89-4b39-a4fd-53a4f909fe07 already deleted. [ 607.499909] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf2aeae6-2e89-4b39-a4fd-53a4f909fe07" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.635037] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.635037] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.635037] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.635261] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.635261] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.635261] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 is going to be created. [ 607.666655] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.666957] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.666957] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.669125] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.669125] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.681071] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: UNINITIALIZED for 2s [ 607.727624] env[65783]: INFO networking_nsxv3.common.synchronization [req-ab3ab16e-7619-4ba6-8ccd-013f97240b56 req-52a57f63-7031-42d8-8f6b-93f9df4bc9ed tempest-ServerActionsTestOtherA-298845163 tempest-ServerActionsTestOtherA-298845163-project-member] Enqueued Resource ID: aaf15510-666a-49d9-9a20-6f398b7f8216 with Priority: HIGHEST for action security_group_members [ 607.728594] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaf15510-666a-49d9-9a20-6f398b7f8216 with Priority: HIGHEST for action security_group_members [ 607.728930] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaf15510-666a-49d9-9a20-6f398b7f8216 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.730290] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.730392] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.730724] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.730913] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.731053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.731129] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.731294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.731379] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.731488] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aaf15510-666a-49d9-9a20-6f398b7f8216',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.871838] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.871838] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.871838] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.871838] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.871838] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.871838] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 already deleted. [ 607.871838] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.236176] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.236575] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.236575] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.236652] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.236695] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.236975] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.237105] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.237105] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.237291] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.237393] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.237545] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aaf15510-666a-49d9-9a20-6f398b7f8216 already deleted. [ 608.237581] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.353954] env[65783]: INFO networking_nsxv3.common.synchronization [None req-4dd7d6b3-f089-49af-9262-25ee9417246e tempest-ServersWithSpecificFlavorTestJSON-767212478 tempest-ServersWithSpecificFlavorTestJSON-767212478-project-member] Enqueued Resource ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 with Priority: HIGHEST for action security_group_rules [ 608.354411] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 with Priority: HIGHEST for action security_group_rules [ 608.354719] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e588ff7c-d45a-4b75-823e-f219eeb5e814 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.354841] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.354901] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.355119] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.355226] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e588ff7c-d45a-4b75-823e-f219eeb5e814',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.467373] env[65783]: INFO networking_nsxv3.common.synchronization [None req-3222d47f-d912-469d-8bc3-4859b2720f54 None None] Enqueued Resource ID: dd1e4f83-a100-4100-84a6-f5cc4d6f2e0c with Priority: HIGHEST for action port [ 608.467373] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd1e4f83-a100-4100-84a6-f5cc4d6f2e0c with Priority: HIGHEST for action port [ 608.467373] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd1e4f83-a100-4100-84a6-f5cc4d6f2e0c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.467373] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd1e4f83-a100-4100-84a6-f5cc4d6f2e0c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.467373] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd1e4f83-a100-4100-84a6-f5cc4d6f2e0c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.467646] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd1e4f83-a100-4100-84a6-f5cc4d6f2e0c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.468773] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd1e4f83-a100-4100-84a6-f5cc4d6f2e0c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.811225] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-678 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.811225] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-678" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.811225] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-678" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.811225] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-678" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.811531] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.811648] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.814505] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.814773] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.814926] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.815151] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 608.815257] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 608.815357] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 608.815454] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 608.815557] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 608.815654] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 608.815773] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 608.837948] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 608.838112] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 608.838282] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 608.838415] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-678" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.838981] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-e936d0e7-de51-4ac2-9b4a-08f999624c5c taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.838981] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-e936d0e7-de51-4ac2-9b4a-08f999624c5c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.838981] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-e936d0e7-de51-4ac2-9b4a-08f999624c5c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.839308] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-e936d0e7-de51-4ac2-9b4a-08f999624c5c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.839441] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e936d0e7-de51-4ac2-9b4a-08f999624c5c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.879435] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.879704] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.879704] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.879884] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.879984] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.880095] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 already deleted. [ 608.880180] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.970309] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd1e4f83-a100-4100-84a6-f5cc4d6f2e0c [ 608.970362] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.971015] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.971015] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.971015] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.971015] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.971015] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd1e4f83-a100-4100-84a6-f5cc4d6f2e0c already deleted. [ 608.971308] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd1e4f83-a100-4100-84a6-f5cc4d6f2e0c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.973240] env[65783]: INFO networking_nsxv3.common.synchronization [None req-c4531112-a8a8-4068-9b6f-891121e92554 None None] Enqueued Resource ID: 516f7dc1-3224-4381-9f6d-abbdfeacaa6b with Priority: HIGHEST for action port [ 608.973460] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 516f7dc1-3224-4381-9f6d-abbdfeacaa6b with Priority: HIGHEST for action port [ 608.974063] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-516f7dc1-3224-4381-9f6d-abbdfeacaa6b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.974221] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-516f7dc1-3224-4381-9f6d-abbdfeacaa6b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.974257] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-516f7dc1-3224-4381-9f6d-abbdfeacaa6b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.975135] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-516f7dc1-3224-4381-9f6d-abbdfeacaa6b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.975135] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('516f7dc1-3224-4381-9f6d-abbdfeacaa6b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.344020] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.344020] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.344020] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.344020] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.344020] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.344020] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port e936d0e7-de51-4ac2-9b4a-08f999624c5c not found, creating... [ 609.344020] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.344020] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.344020] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.344654] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.344654] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.344654] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.344774] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.344827] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.346193] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.346394] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.346541] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: e936d0e7-de51-4ac2-9b4a-08f999624c5c is going to be created. [ 609.371186] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.371677] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.371677] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.372529] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.372529] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.372529] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-e936d0e7-de51-4ac2-9b4a-08f999624c5c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.477430] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 516f7dc1-3224-4381-9f6d-abbdfeacaa6b [ 609.477430] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.477430] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.477430] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.477430] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.477430] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.477430] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:516f7dc1-3224-4381-9f6d-abbdfeacaa6b already deleted. [ 609.477430] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-516f7dc1-3224-4381-9f6d-abbdfeacaa6b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.695009] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: SUCCESS [ 609.695272] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.695463] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.695706] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.695926] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.696132] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.696253] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.696503] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.696655] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.696809] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.697152] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.702961] env[65783]: INFO networking_nsxv3.common.synchronization [req-912013ab-6b52-44ee-8789-97c390bcc9dc req-5d29a1fc-8bce-43c0-9acb-5ee85a05cfa0 tempest-ServerActionsTestOtherB-29394606 tempest-ServerActionsTestOtherB-29394606-project-member] Enqueued Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_members [ 609.703535] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_members [ 609.703845] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c81f8cb-609b-4496-9f07-b80abbe519f8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.703978] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.704216] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.704528] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.704737] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.705044] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.705044] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.705624] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.705774] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.705907] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.059124] env[65783]: INFO networking_nsxv3.common.synchronization [req-ab3ab16e-7619-4ba6-8ccd-013f97240b56 req-1933ad38-89ee-4bb5-bc5a-c40076cdea40 service nova] Enqueued Resource ID: aaf15510-666a-49d9-9a20-6f398b7f8216 with Priority: HIGHEST for action security_group_rules [ 610.059323] env[65783]: INFO networking_nsxv3.common.synchronization [req-ab3ab16e-7619-4ba6-8ccd-013f97240b56 req-1933ad38-89ee-4bb5-bc5a-c40076cdea40 service nova] Enqueued Resource ID: aaf15510-666a-49d9-9a20-6f398b7f8216 with Priority: HIGHEST for action security_group_members [ 610.059465] env[65783]: INFO networking_nsxv3.common.synchronization [req-ab3ab16e-7619-4ba6-8ccd-013f97240b56 req-1933ad38-89ee-4bb5-bc5a-c40076cdea40 service nova] Enqueued Resource ID: e936d0e7-de51-4ac2-9b4a-08f999624c5c with Priority: HIGHEST for action port [ 610.060070] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaf15510-666a-49d9-9a20-6f398b7f8216 with Priority: HIGHEST for action security_group_rules [ 610.060231] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaf15510-666a-49d9-9a20-6f398b7f8216 with Priority: HIGHEST for action security_group_members [ 610.060350] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e936d0e7-de51-4ac2-9b4a-08f999624c5c with Priority: HIGHEST for action port [ 610.060683] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aaf15510-666a-49d9-9a20-6f398b7f8216 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.060807] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.060870] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.061107] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.061184] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aaf15510-666a-49d9-9a20-6f398b7f8216',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.062759] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaf15510-666a-49d9-9a20-6f398b7f8216 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.062759] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.062759] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.062759] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.062759] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.062759] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.062759] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.063082] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.063082] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.063149] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aaf15510-666a-49d9-9a20-6f398b7f8216',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.063830] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-e936d0e7-de51-4ac2-9b4a-08f999624c5c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.064154] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e936d0e7-de51-4ac2-9b4a-08f999624c5c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.064154] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e936d0e7-de51-4ac2-9b4a-08f999624c5c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.064269] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e936d0e7-de51-4ac2-9b4a-08f999624c5c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.064269] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e936d0e7-de51-4ac2-9b4a-08f999624c5c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.199964] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.200170] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.200237] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.200431] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.200598] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.200697] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.200758] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.200906] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.200993] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.201092] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.201237] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.201328] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.201386] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.201523] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.201664] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.201756] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.201817] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.201994] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.202070] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.202154] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.202259] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.208679] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.208817] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.208876] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.209072] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.209160] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.210098] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.210230] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.210296] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.210564] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.210619] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.210708] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 already deleted. [ 610.210742] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.427198] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-702 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.427198] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-702" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.427198] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-702" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.427198] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-702" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.427198] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.427198] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.427198] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.427198] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.427198] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.428100] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 610.428516] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 610.428761] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 610.428961] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 610.429175] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 610.433099] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 610.433099] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 610.452660] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 610.452660] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 610.452792] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 610.452969] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-702" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.453297] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-d6e04a22-9f86-43c9-ac42-95191eaf454b taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.453458] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-d6e04a22-9f86-43c9-ac42-95191eaf454b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.453572] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-d6e04a22-9f86-43c9-ac42-95191eaf454b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.453996] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-d6e04a22-9f86-43c9-ac42-95191eaf454b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.454197] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6e04a22-9f86-43c9-ac42-95191eaf454b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.568025] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aaf15510-666a-49d9-9a20-6f398b7f8216',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.568025] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaf15510-666a-49d9-9a20-6f398b7f8216 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.568025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.568025] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e936d0e7-de51-4ac2-9b4a-08f999624c5c with status ACTIVE [ 610.568025] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.568025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.568025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.568025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.568025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.568025] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.568557] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.568557] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.568557] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.568557] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.568557] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.568706] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.568706] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.570139] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.570139] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.570139] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e936d0e7-de51-4ac2-9b4a-08f999624c5c is going to be updated. [ 610.592933] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.593096] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.593383] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.593383] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.593521] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.593631] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e936d0e7-de51-4ac2-9b4a-08f999624c5c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.609773] env[65783]: INFO networking_nsxv3.common.synchronization [None req-fc233cea-baa7-4c32-8e63-2f738b5c71dc None None] Enqueued Resource ID: 23e400e1-9477-4c9c-8a36-53ded0cd39d7 with Priority: HIGHEST for action port [ 610.609773] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23e400e1-9477-4c9c-8a36-53ded0cd39d7 with Priority: HIGHEST for action port [ 610.609773] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-23e400e1-9477-4c9c-8a36-53ded0cd39d7 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.609953] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23e400e1-9477-4c9c-8a36-53ded0cd39d7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.609953] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23e400e1-9477-4c9c-8a36-53ded0cd39d7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.610789] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23e400e1-9477-4c9c-8a36-53ded0cd39d7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.610924] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23e400e1-9477-4c9c-8a36-53ded0cd39d7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.708472] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9943d881-28bf-4885-906c-d360f9c2c3e7: rpc.has_security_group_logging(os_id): False [ 610.737400] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.737542] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.737614] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.737824] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.738054] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.738138] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.738241] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.738305] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.738467] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.738545] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.738744] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.738839] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.738894] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.739053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.739112] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.739329] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.739376] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.739429] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.739605] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.740216] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.740366] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 is going to be created. [ 610.824667] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.827016] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.827016] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.827016] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.827016] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.839576] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: IN_PROGRESS for 2s [ 610.956832] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.957205] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.957205] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.957553] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.957654] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.957835] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port d6e04a22-9f86-43c9-ac42-95191eaf454b not found, creating... [ 610.958113] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.958273] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.958382] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.958612] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.958728] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.959107] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.959199] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.959276] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.959458] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.959618] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.959768] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: d6e04a22-9f86-43c9-ac42-95191eaf454b is going to be created. [ 610.991909] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.992141] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.992263] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.992553] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.993249] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.993249] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-d6e04a22-9f86-43c9-ac42-95191eaf454b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.057317] env[65783]: INFO networking_nsxv3.common.synchronization [None req-16ec9456-40a6-47c0-9a97-6513fbdf8baa None None] Enqueued Resource ID: e7815749-c15d-427b-a35f-57d005aaec1f with Priority: HIGHEST for action port [ 611.057648] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7815749-c15d-427b-a35f-57d005aaec1f with Priority: HIGHEST for action port [ 611.058281] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7815749-c15d-427b-a35f-57d005aaec1f taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.058393] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7815749-c15d-427b-a35f-57d005aaec1f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.058454] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7815749-c15d-427b-a35f-57d005aaec1f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.058696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7815749-c15d-427b-a35f-57d005aaec1f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.058771] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7815749-c15d-427b-a35f-57d005aaec1f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.068744] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aaf15510-666a-49d9-9a20-6f398b7f8216',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.113161] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23e400e1-9477-4c9c-8a36-53ded0cd39d7 [ 611.113401] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.113538] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.113606] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.113890] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.113980] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.114093] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23e400e1-9477-4c9c-8a36-53ded0cd39d7 already deleted. [ 611.114190] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23e400e1-9477-4c9c-8a36-53ded0cd39d7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.560820] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7815749-c15d-427b-a35f-57d005aaec1f [ 611.560820] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.561230] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.561230] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.561230] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.561385] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.561385] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7815749-c15d-427b-a35f-57d005aaec1f already deleted. [ 611.561533] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7815749-c15d-427b-a35f-57d005aaec1f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.572058] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.572264] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.572264] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.572380] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.572464] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.572566] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aaf15510-666a-49d9-9a20-6f398b7f8216 is going to be created. [ 611.598185] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.598379] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.598444] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.598764] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.598950] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.612276] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaf15510-666a-49d9-9a20-6f398b7f8216 in Status: UNINITIALIZED for 2s [ 611.734098] env[65783]: INFO networking_nsxv3.common.synchronization [req-912013ab-6b52-44ee-8789-97c390bcc9dc req-157e182c-7242-4dde-a9df-def116e4544d service nova] Enqueued Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_rules [ 611.734312] env[65783]: INFO networking_nsxv3.common.synchronization [req-912013ab-6b52-44ee-8789-97c390bcc9dc req-157e182c-7242-4dde-a9df-def116e4544d service nova] Enqueued Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_members [ 611.734454] env[65783]: INFO networking_nsxv3.common.synchronization [req-912013ab-6b52-44ee-8789-97c390bcc9dc req-157e182c-7242-4dde-a9df-def116e4544d service nova] Enqueued Resource ID: d6e04a22-9f86-43c9-ac42-95191eaf454b with Priority: HIGHEST for action port [ 611.735177] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_rules [ 611.735335] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_members [ 611.735542] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e04a22-9f86-43c9-ac42-95191eaf454b with Priority: HIGHEST for action port [ 611.735886] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c81f8cb-609b-4496-9f07-b80abbe519f8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.736079] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.736257] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.736436] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.736541] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.738294] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c81f8cb-609b-4496-9f07-b80abbe519f8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.738294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.738294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.738294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.738294] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.738294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.738294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.738669] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.738669] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.739398] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.740105] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6e04a22-9f86-43c9-ac42-95191eaf454b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.740272] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6e04a22-9f86-43c9-ac42-95191eaf454b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.740403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6e04a22-9f86-43c9-ac42-95191eaf454b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.740715] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6e04a22-9f86-43c9-ac42-95191eaf454b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.741470] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6e04a22-9f86-43c9-ac42-95191eaf454b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.884590] env[65783]: INFO networking_nsxv3.common.synchronization [req-bcaf55d4-069a-4482-a549-65064b9b9168 req-9a8cee44-77fe-4071-9ec8-068e186864df tempest-VolumesAssistedSnapshotsTest-1577585050 tempest-VolumesAssistedSnapshotsTest-1577585050-project-member] Enqueued Resource ID: 527a6015-4311-4050-9945-7b4c6e602f59 with Priority: HIGHEST for action security_group_members [ 611.885114] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527a6015-4311-4050-9945-7b4c6e602f59 with Priority: HIGHEST for action security_group_members [ 611.885415] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-527a6015-4311-4050-9945-7b4c6e602f59 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.885537] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.885603] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.885863] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.886360] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.886684] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.886684] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.886847] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.886948] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.887055] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('527a6015-4311-4050-9945-7b4c6e602f59',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.243168] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c81f8cb-609b-4496-9f07-b80abbe519f8 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.243307] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.243537] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.246559] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6e04a22-9f86-43c9-ac42-95191eaf454b with status ACTIVE [ 612.246762] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.246890] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.246957] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.247388] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.247388] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.247507] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.247699] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.247865] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.248074] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.248161] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.248367] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.248574] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.248641] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.248929] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.249034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.249130] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6e04a22-9f86-43c9-ac42-95191eaf454b is going to be updated. [ 612.272872] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.273034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.273096] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.273304] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.273435] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.273625] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6e04a22-9f86-43c9-ac42-95191eaf454b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.292843] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-867 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.293082] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-867" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.293218] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-867" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.293532] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-867" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.294253] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.294253] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.294702] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.294966] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.295178] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.295498] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.295592] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 612.295743] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 612.295888] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 612.296094] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.296272] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 612.296448] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 612.316385] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 612.316533] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 612.316681] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 612.316862] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-867" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.317184] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-709378e7-1b93-4d0c-9649-3fb90a38b091 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.317350] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-709378e7-1b93-4d0c-9649-3fb90a38b091" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.317463] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-709378e7-1b93-4d0c-9649-3fb90a38b091" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.317870] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-709378e7-1b93-4d0c-9649-3fb90a38b091" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.318053] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('709378e7-1b93-4d0c-9649-3fb90a38b091',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.390890] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.391349] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.391531] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.391936] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.392566] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.392951] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.393620] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.393620] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.393620] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.393766] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.393962] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 527a6015-4311-4050-9945-7b4c6e602f59 already deleted. [ 612.394130] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.662253] env[65783]: INFO networking_nsxv3.common.synchronization [req-5afd7e97-d0da-4d31-8744-a271a0f7cdea req-26984e5b-0f1e-4d54-b815-2a332bca4f1e tempest-ServerMetadataNegativeTestJSON-249816056 tempest-ServerMetadataNegativeTestJSON-249816056-project-member] Enqueued Resource ID: faef4af0-512c-4f90-a00c-065908fadd11 with Priority: HIGHEST for action security_group_members [ 612.663258] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faef4af0-512c-4f90-a00c-065908fadd11 with Priority: HIGHEST for action security_group_members [ 612.663825] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-faef4af0-512c-4f90-a00c-065908fadd11 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.664060] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.664183] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.666439] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.666439] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.666439] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.666439] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.668021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.668178] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.668354] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('faef4af0-512c-4f90-a00c-065908fadd11',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.747097] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.820584] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.820946] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.820946] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.821165] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.821277] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.821393] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 709378e7-1b93-4d0c-9649-3fb90a38b091 not found, creating... [ 612.821828] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.821828] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.822008] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.822326] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.822326] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.822628] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.822811] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.822982] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.823282] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.823417] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.823574] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 709378e7-1b93-4d0c-9649-3fb90a38b091 is going to be created. [ 612.862535] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.862738] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.862867] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.863256] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.863543] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.863778] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-709378e7-1b93-4d0c-9649-3fb90a38b091" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.865936] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: SUCCESS [ 612.866150] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.170853] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.171028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.171107] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.171335] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.171427] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.171623] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.171726] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.171790] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.171984] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.172087] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.172293] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: faef4af0-512c-4f90-a00c-065908fadd11 already deleted. [ 613.172293] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.251091] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.251091] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.251091] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.251091] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.251091] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.251091] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 is going to be created. [ 613.281494] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.281494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.281698] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.281754] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.281905] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.300079] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: UNINITIALIZED for 2s [ 613.389545] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-945 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.389879] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-945" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.390065] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-945" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.390470] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-945" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.391405] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.391748] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.391748] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.391941] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.392107] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.392310] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.392422] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 613.392527] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 613.392867] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 613.392867] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.392867] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 613.393015] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 613.415267] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 613.415340] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 613.415475] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 613.415675] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-945" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.416251] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-855a1c9a-f74e-4cca-afa1-a8bb99f21513 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.416471] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-855a1c9a-f74e-4cca-afa1-a8bb99f21513" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.416530] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-855a1c9a-f74e-4cca-afa1-a8bb99f21513" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.416887] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-855a1c9a-f74e-4cca-afa1-a8bb99f21513" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.417159] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('855a1c9a-f74e-4cca-afa1-a8bb99f21513',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.558710] env[65783]: INFO networking_nsxv3.common.synchronization [req-bcaf55d4-069a-4482-a549-65064b9b9168 req-8279f0cc-5f22-4864-a851-f864a69de34a service nova] Enqueued Resource ID: 527a6015-4311-4050-9945-7b4c6e602f59 with Priority: HIGHEST for action security_group_rules [ 613.558873] env[65783]: INFO networking_nsxv3.common.synchronization [req-bcaf55d4-069a-4482-a549-65064b9b9168 req-8279f0cc-5f22-4864-a851-f864a69de34a service nova] Enqueued Resource ID: 527a6015-4311-4050-9945-7b4c6e602f59 with Priority: HIGHEST for action security_group_members [ 613.559020] env[65783]: INFO networking_nsxv3.common.synchronization [req-bcaf55d4-069a-4482-a549-65064b9b9168 req-8279f0cc-5f22-4864-a851-f864a69de34a service nova] Enqueued Resource ID: 709378e7-1b93-4d0c-9649-3fb90a38b091 with Priority: HIGHEST for action port [ 613.559697] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527a6015-4311-4050-9945-7b4c6e602f59 with Priority: HIGHEST for action security_group_rules [ 613.559836] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527a6015-4311-4050-9945-7b4c6e602f59 with Priority: HIGHEST for action security_group_members [ 613.559928] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709378e7-1b93-4d0c-9649-3fb90a38b091 with Priority: HIGHEST for action port [ 613.560463] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-527a6015-4311-4050-9945-7b4c6e602f59 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.560463] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.560463] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.560738] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.560738] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('527a6015-4311-4050-9945-7b4c6e602f59',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.562587] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-527a6015-4311-4050-9945-7b4c6e602f59 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.562587] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.562587] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.562587] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.562587] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.562587] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.562587] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.562587] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.562587] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.563026] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('527a6015-4311-4050-9945-7b4c6e602f59',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.563595] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-709378e7-1b93-4d0c-9649-3fb90a38b091 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.563595] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-709378e7-1b93-4d0c-9649-3fb90a38b091" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.564150] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-709378e7-1b93-4d0c-9649-3fb90a38b091" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.564150] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-709378e7-1b93-4d0c-9649-3fb90a38b091" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.564150] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('709378e7-1b93-4d0c-9649-3fb90a38b091',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.625083] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaf15510-666a-49d9-9a20-6f398b7f8216 in Status: SUCCESS [ 613.625427] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.625710] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.626059] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.626347] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.626541] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.626767] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.626982] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.627102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.627249] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.627309] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aaf15510-666a-49d9-9a20-6f398b7f8216',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.881359] env[65783]: INFO networking_nsxv3.common.synchronization [None req-4e3a33e8-2774-4944-9cd5-c43023376b68 None None] Enqueued Resource ID: 68a0cfe8-65a8-48e4-845d-9b04561e5ffa with Priority: HIGHEST for action port [ 613.884143] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68a0cfe8-65a8-48e4-845d-9b04561e5ffa with Priority: HIGHEST for action port [ 613.884799] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-68a0cfe8-65a8-48e4-845d-9b04561e5ffa taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.884945] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68a0cfe8-65a8-48e4-845d-9b04561e5ffa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.884996] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68a0cfe8-65a8-48e4-845d-9b04561e5ffa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.885324] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68a0cfe8-65a8-48e4-845d-9b04561e5ffa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.886024] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68a0cfe8-65a8-48e4-845d-9b04561e5ffa',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.920424] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.920722] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.920886] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.921290] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.921490] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.921616] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 855a1c9a-f74e-4cca-afa1-a8bb99f21513 not found, creating... [ 613.921952] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.922153] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.922270] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.923589] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.923739] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.924101] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.924493] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.924778] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.924972] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.925121] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.925260] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 855a1c9a-f74e-4cca-afa1-a8bb99f21513 is going to be created. [ 613.949761] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.950117] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.950252] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.950530] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.950751] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.950969] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-855a1c9a-f74e-4cca-afa1-a8bb99f21513" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.065758] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-527a6015-4311-4050-9945-7b4c6e602f59 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.065899] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.066475] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 709378e7-1b93-4d0c-9649-3fb90a38b091 with status ACTIVE [ 614.066659] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.066789] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.066845] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.067045] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.067134] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.067304] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.067399] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.067465] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.067708] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.067787] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.068009] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.068070] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.068130] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.068266] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.068337] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.068430] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 709378e7-1b93-4d0c-9649-3fb90a38b091 is going to be updated. [ 614.069499] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('527a6015-4311-4050-9945-7b4c6e602f59',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.096172] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.096424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.096424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.096561] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.096697] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.096855] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-709378e7-1b93-4d0c-9649-3fb90a38b091" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.129484] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aaf15510-666a-49d9-9a20-6f398b7f8216',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.388716] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68a0cfe8-65a8-48e4-845d-9b04561e5ffa [ 614.388716] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.388878] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.388878] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.389253] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.389253] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.389326] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68a0cfe8-65a8-48e4-845d-9b04561e5ffa already deleted. [ 614.389400] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68a0cfe8-65a8-48e4-845d-9b04561e5ffa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.572302] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('527a6015-4311-4050-9945-7b4c6e602f59',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.632290] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aaf15510-666a-49d9-9a20-6f398b7f8216: rpc.has_security_group_logging(os_id): False [ 614.655146] env[65783]: INFO networking_nsxv3.common.synchronization [req-5afd7e97-d0da-4d31-8744-a271a0f7cdea req-7155e34b-600a-4168-bbcf-38cf56cb0bd2 service nova] Enqueued Resource ID: faef4af0-512c-4f90-a00c-065908fadd11 with Priority: HIGHEST for action security_group_rules [ 614.655146] env[65783]: INFO networking_nsxv3.common.synchronization [req-5afd7e97-d0da-4d31-8744-a271a0f7cdea req-7155e34b-600a-4168-bbcf-38cf56cb0bd2 service nova] Enqueued Resource ID: faef4af0-512c-4f90-a00c-065908fadd11 with Priority: HIGHEST for action security_group_members [ 614.655300] env[65783]: INFO networking_nsxv3.common.synchronization [req-5afd7e97-d0da-4d31-8744-a271a0f7cdea req-7155e34b-600a-4168-bbcf-38cf56cb0bd2 service nova] Enqueued Resource ID: 855a1c9a-f74e-4cca-afa1-a8bb99f21513 with Priority: HIGHEST for action port [ 614.660973] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.660973] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.660973] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.660973] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.660973] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.660973] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.660973] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.660973] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.660973] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.660973] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.660973] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aaf15510-666a-49d9-9a20-6f398b7f8216 is going to be created. [ 614.664032] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faef4af0-512c-4f90-a00c-065908fadd11 with Priority: HIGHEST for action security_group_rules [ 614.665366] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faef4af0-512c-4f90-a00c-065908fadd11 with Priority: HIGHEST for action security_group_members [ 614.665897] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 855a1c9a-f74e-4cca-afa1-a8bb99f21513 with Priority: HIGHEST for action port [ 614.666833] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-faef4af0-512c-4f90-a00c-065908fadd11 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.666833] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.666833] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.667527] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.668308] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('faef4af0-512c-4f90-a00c-065908fadd11',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.671353] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-faef4af0-512c-4f90-a00c-065908fadd11 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.671689] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.672955] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.673163] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.673857] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.674343] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.674343] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.674620] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.674800] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.675440] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('faef4af0-512c-4f90-a00c-065908fadd11',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.678949] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-855a1c9a-f74e-4cca-afa1-a8bb99f21513 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.678949] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-855a1c9a-f74e-4cca-afa1-a8bb99f21513" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.678949] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-855a1c9a-f74e-4cca-afa1-a8bb99f21513" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.678949] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-855a1c9a-f74e-4cca-afa1-a8bb99f21513" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.679219] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('855a1c9a-f74e-4cca-afa1-a8bb99f21513',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.706528] env[65783]: INFO networking_nsxv3.common.synchronization [req-61821ec9-72cf-4fb1-b46e-5e39ef7b01ec req-be6936c2-79ba-4ea8-a6b8-8b4f2313f112 tempest-DeleteServersAdminTestJSON-532503792 tempest-DeleteServersAdminTestJSON-532503792-project-admin] Enqueued Resource ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 with Priority: HIGHEST for action security_group_members [ 614.708245] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 with Priority: HIGHEST for action security_group_members [ 614.708906] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.709047] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.709097] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.709680] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.709680] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.709800] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.709800] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.709973] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.710117] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.710224] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.753418] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.753674] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.753833] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.754216] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.756552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.771585] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aaf15510-666a-49d9-9a20-6f398b7f8216 in Status: IN_PROGRESS for 2s [ 615.075225] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.075791] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.075791] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.075791] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.075791] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.075791] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 527a6015-4311-4050-9945-7b4c6e602f59 is going to be created. [ 615.106061] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.106061] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.106061] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.106061] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.106061] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.117465] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527a6015-4311-4050-9945-7b4c6e602f59 in Status: UNINITIALIZED for 2s [ 615.184838] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-faef4af0-512c-4f90-a00c-065908fadd11 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.185068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.185318] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('faef4af0-512c-4f90-a00c-065908fadd11',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.186466] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 855a1c9a-f74e-4cca-afa1-a8bb99f21513 with status ACTIVE [ 615.186773] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.186943] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.187107] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.187354] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.187611] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.187849] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.187983] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.188523] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.188734] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.188834] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.189055] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.189185] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.189283] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.189631] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.189725] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.190392] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 855a1c9a-f74e-4cca-afa1-a8bb99f21513 is going to be updated. [ 615.218495] env[65783]: INFO networking_nsxv3.common.synchronization [None req-7cfb7b53-ccbc-41fe-a2b7-a31fbd32e3c3 None None] Enqueued Resource ID: 355fe321-a5c0-4c6d-999a-9aa28e86be77 with Priority: HIGHEST for action port [ 615.222181] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.222181] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.222181] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.222181] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.222181] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.222181] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.222181] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.222181] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.222181] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.222181] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.222181] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 is going to be updated. [ 615.223146] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 355fe321-a5c0-4c6d-999a-9aa28e86be77 with Priority: HIGHEST for action port [ 615.223146] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-355fe321-a5c0-4c6d-999a-9aa28e86be77 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.223146] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-355fe321-a5c0-4c6d-999a-9aa28e86be77" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.223146] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-355fe321-a5c0-4c6d-999a-9aa28e86be77" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.223146] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-355fe321-a5c0-4c6d-999a-9aa28e86be77" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.223146] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('355fe321-a5c0-4c6d-999a-9aa28e86be77',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.242300] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.242480] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.242562] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.242770] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.242899] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.243068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-855a1c9a-f74e-4cca-afa1-a8bb99f21513" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.283494] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.283494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.283494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.283494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.283494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.303939] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 in Status: IN_PROGRESS for 2s [ 615.328434] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: SUCCESS [ 615.328898] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.329677] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.329677] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.329677] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.329677] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.329987] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.329987] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.329987] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.330108] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.330308] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.692415] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('faef4af0-512c-4f90-a00c-065908fadd11',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.726423] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 355fe321-a5c0-4c6d-999a-9aa28e86be77 [ 615.726674] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.726784] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.726849] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.727459] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.727459] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.727459] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:355fe321-a5c0-4c6d-999a-9aa28e86be77 already deleted. [ 615.727459] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-355fe321-a5c0-4c6d-999a-9aa28e86be77" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.833171] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.195121] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.195443] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.195443] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.195836] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.196024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.196084] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: faef4af0-512c-4f90-a00c-065908fadd11 is going to be created. [ 616.222453] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.222606] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.222710] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.223152] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.223331] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.237236] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: faef4af0-512c-4f90-a00c-065908fadd11 in Status: UNINITIALIZED for 2s [ 616.337831] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c81f8cb-609b-4496-9f07-b80abbe519f8: rpc.has_security_group_logging(os_id): False [ 616.374653] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.374653] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.374653] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.374653] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.374653] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.374653] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.374653] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.374653] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.374653] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.374997] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.375155] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 is going to be created. [ 616.455269] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.455646] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.455781] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.456356] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.456682] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.472199] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: IN_PROGRESS for 2s [ 616.793179] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aaf15510-666a-49d9-9a20-6f398b7f8216 in Status: SUCCESS [ 616.793179] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.129334] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527a6015-4311-4050-9945-7b4c6e602f59 in Status: SUCCESS [ 617.129577] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.129772] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.130029] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.130232] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.130391] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.130433] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.130557] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.130633] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.130742] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.130785] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('527a6015-4311-4050-9945-7b4c6e602f59',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.315534] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 in Status: SUCCESS [ 617.316181] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 deletion is rescheduled due to dependency. [ 617.316181] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.406490] env[65783]: INFO networking_nsxv3.common.synchronization [None req-011e4e5e-7469-4a60-8407-dbc2a1b9424e None None] Enqueued Resource ID: 2ed8368f-5d17-4e90-a1f3-687e269c24b0 with Priority: HIGHEST for action port [ 617.407104] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ed8368f-5d17-4e90-a1f3-687e269c24b0 with Priority: HIGHEST for action port [ 617.407425] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ed8368f-5d17-4e90-a1f3-687e269c24b0 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.407840] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ed8368f-5d17-4e90-a1f3-687e269c24b0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.407840] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ed8368f-5d17-4e90-a1f3-687e269c24b0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.408030] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ed8368f-5d17-4e90-a1f3-687e269c24b0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.408030] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ed8368f-5d17-4e90-a1f3-687e269c24b0',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.634359] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('527a6015-4311-4050-9945-7b4c6e602f59',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.917042] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ed8368f-5d17-4e90-a1f3-687e269c24b0 [ 617.917286] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.917424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.917494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.917743] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.917835] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.917935] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ed8368f-5d17-4e90-a1f3-687e269c24b0 already deleted. [ 617.918020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ed8368f-5d17-4e90-a1f3-687e269c24b0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.137585] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 527a6015-4311-4050-9945-7b4c6e602f59: rpc.has_security_group_logging(os_id): False [ 618.159426] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.159687] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.159765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.160041] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.160078] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.160304] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.160429] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.162328] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.162328] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.162328] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.162328] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 527a6015-4311-4050-9945-7b4c6e602f59 is going to be created. [ 618.227142] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.227693] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.227779] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.228011] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.228217] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.240926] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 527a6015-4311-4050-9945-7b4c6e602f59 in Status: IN_PROGRESS for 2s [ 618.249145] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: faef4af0-512c-4f90-a00c-065908fadd11 in Status: SUCCESS [ 618.249145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.249145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.249145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.249145] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.249145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.249145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.249145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.249145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.249145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.249145] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('faef4af0-512c-4f90-a00c-065908fadd11',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.486537] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: SUCCESS [ 618.486870] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.751313] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-faef4af0-512c-4f90-a00c-065908fadd11 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.751479] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.751542] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.751762] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.752864] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.752864] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.752864] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.752864] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.752864] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.752864] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.752864] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-faef4af0-512c-4f90-a00c-065908fadd11 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.752864] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.752864] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.752864] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.753839] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.753839] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.753839] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.753839] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.753839] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.757141] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.757141] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('faef4af0-512c-4f90-a00c-065908fadd11',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.875466] env[65783]: INFO networking_nsxv3.common.synchronization [req-bed5556a-e90e-4b20-87bb-cfcead15d3c4 req-a9b46b48-92e0-4631-ba75-479aae874583 tempest-TenantUsagesTestJSON-1133126431 tempest-TenantUsagesTestJSON-1133126431-project-member] Enqueued Resource ID: 8fb4d28c-13d7-48fd-b533-e7a002a7949d with Priority: HIGHEST for action security_group_members [ 618.876294] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fb4d28c-13d7-48fd-b533-e7a002a7949d with Priority: HIGHEST for action security_group_members [ 618.877697] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fb4d28c-13d7-48fd-b533-e7a002a7949d taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.878222] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.878347] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.878682] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.879760] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.879760] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.879760] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.879760] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.879760] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.879760] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fb4d28c-13d7-48fd-b533-e7a002a7949d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.201362] env[65783]: INFO networking_nsxv3.common.synchronization [None req-2265426d-fe0c-480f-a7da-1e5c54fd914c None None] Enqueued Resource ID: fe416bf2-968d-4ed3-ac08-4459eb54f889 with Priority: HIGHEST for action port [ 619.201362] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe416bf2-968d-4ed3-ac08-4459eb54f889 with Priority: HIGHEST for action port [ 619.201362] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe416bf2-968d-4ed3-ac08-4459eb54f889 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.201362] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe416bf2-968d-4ed3-ac08-4459eb54f889" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.201362] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe416bf2-968d-4ed3-ac08-4459eb54f889" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.201362] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe416bf2-968d-4ed3-ac08-4459eb54f889" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.201362] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe416bf2-968d-4ed3-ac08-4459eb54f889',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.258723] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for faef4af0-512c-4f90-a00c-065908fadd11: rpc.has_security_group_logging(os_id): False [ 619.284586] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.284794] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.284854] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.285105] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.285194] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.285440] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.285541] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.285611] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.285771] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.285855] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.286050] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.286142] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.286201] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.286334] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.286411] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.286604] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.286694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.286768] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.286918] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.286993] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.287292] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: faef4af0-512c-4f90-a00c-065908fadd11 is going to be created. [ 619.367196] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.367662] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.368642] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.368642] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.368642] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.384204] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.384577] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.385100] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.385216] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.385283] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.386341] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.386341] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.386341] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.386341] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.386341] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.386614] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fb4d28c-13d7-48fd-b533-e7a002a7949d already deleted. [ 619.386614] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.390149] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: faef4af0-512c-4f90-a00c-065908fadd11 in Status: IN_PROGRESS for 2s [ 619.610559] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-251 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.611567] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.611567] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.616028] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.616028] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.616028] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.616028] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.616028] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.616028] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.616028] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.616028] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 619.616028] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 619.616028] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 619.616028] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.616028] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 619.616028] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 619.636234] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 619.636572] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 619.636572] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 619.636775] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.637011] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-c4fe2c1f-0ceb-4270-9ae5-7aa0b74d2b8b taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.637202] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-c4fe2c1f-0ceb-4270-9ae5-7aa0b74d2b8b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.637339] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-c4fe2c1f-0ceb-4270-9ae5-7aa0b74d2b8b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.637870] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-c4fe2c1f-0ceb-4270-9ae5-7aa0b74d2b8b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.637870] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4fe2c1f-0ceb-4270-9ae5-7aa0b74d2b8b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.702658] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe416bf2-968d-4ed3-ac08-4459eb54f889 [ 619.703496] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.703681] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.703758] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.705541] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.705719] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.705830] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe416bf2-968d-4ed3-ac08-4459eb54f889 already deleted. [ 619.706043] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe416bf2-968d-4ed3-ac08-4459eb54f889" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.141033] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.141033] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.141033] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.141033] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.141396] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.141396] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port c4fe2c1f-0ceb-4270-9ae5-7aa0b74d2b8b not found, creating... [ 620.141854] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.141854] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.142069] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.142338] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.142535] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.142902] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.143207] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.143381] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.143636] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.143827] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.144115] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: c4fe2c1f-0ceb-4270-9ae5-7aa0b74d2b8b is going to be created. [ 620.169408] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.169625] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.169773] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.170110] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.171374] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.171374] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-c4fe2c1f-0ceb-4270-9ae5-7aa0b74d2b8b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.270940] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 527a6015-4311-4050-9945-7b4c6e602f59 in Status: SUCCESS [ 620.270940] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.955198] env[65783]: INFO networking_nsxv3.common.synchronization [req-bed5556a-e90e-4b20-87bb-cfcead15d3c4 req-e4892b51-db0b-4ca7-8008-466f064aeba0 service nova] Enqueued Resource ID: 8fb4d28c-13d7-48fd-b533-e7a002a7949d with Priority: HIGHEST for action security_group_rules [ 620.956186] env[65783]: INFO networking_nsxv3.common.synchronization [req-bed5556a-e90e-4b20-87bb-cfcead15d3c4 req-e4892b51-db0b-4ca7-8008-466f064aeba0 service nova] Enqueued Resource ID: 8fb4d28c-13d7-48fd-b533-e7a002a7949d with Priority: HIGHEST for action security_group_members [ 620.956186] env[65783]: INFO networking_nsxv3.common.synchronization [req-bed5556a-e90e-4b20-87bb-cfcead15d3c4 req-e4892b51-db0b-4ca7-8008-466f064aeba0 service nova] Enqueued Resource ID: c4fe2c1f-0ceb-4270-9ae5-7aa0b74d2b8b with Priority: HIGHEST for action port [ 620.957151] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fb4d28c-13d7-48fd-b533-e7a002a7949d with Priority: HIGHEST for action security_group_rules [ 620.957151] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fb4d28c-13d7-48fd-b533-e7a002a7949d with Priority: HIGHEST for action security_group_members [ 620.958603] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4fe2c1f-0ceb-4270-9ae5-7aa0b74d2b8b with Priority: HIGHEST for action port [ 620.958603] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8fb4d28c-13d7-48fd-b533-e7a002a7949d taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.958603] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.958603] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.958603] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.958603] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8fb4d28c-13d7-48fd-b533-e7a002a7949d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.959218] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fb4d28c-13d7-48fd-b533-e7a002a7949d taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.959960] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.959960] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.959960] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.959960] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.959960] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.959960] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.960261] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.960261] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.960261] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fb4d28c-13d7-48fd-b533-e7a002a7949d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.961789] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4fe2c1f-0ceb-4270-9ae5-7aa0b74d2b8b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.961789] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4fe2c1f-0ceb-4270-9ae5-7aa0b74d2b8b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.961789] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4fe2c1f-0ceb-4270-9ae5-7aa0b74d2b8b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.961789] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4fe2c1f-0ceb-4270-9ae5-7aa0b74d2b8b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.961789] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4fe2c1f-0ceb-4270-9ae5-7aa0b74d2b8b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.406709] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: faef4af0-512c-4f90-a00c-065908fadd11 in Status: SUCCESS [ 621.407089] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.464111] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8fb4d28c-13d7-48fd-b533-e7a002a7949d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.464841] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fb4d28c-13d7-48fd-b533-e7a002a7949d taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.464976] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.469506] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4fe2c1f-0ceb-4270-9ae5-7aa0b74d2b8b with status ACTIVE [ 621.469964] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.470232] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.470307] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.470576] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.470714] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.470910] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.471023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.471089] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.471259] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.471337] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.471526] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.471635] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.471703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.471967] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.471967] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.471967] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4fe2c1f-0ceb-4270-9ae5-7aa0b74d2b8b is going to be updated. [ 621.493768] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.493918] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.493984] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.494420] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.494566] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.494731] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4fe2c1f-0ceb-4270-9ae5-7aa0b74d2b8b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.884847] env[65783]: INFO networking_nsxv3.common.synchronization [None req-2e05c808-13ef-4bc7-9730-926e20293151 None None] Enqueued Resource ID: f4cf2be4-c286-4874-bcca-378edeb66616 with Priority: HIGHEST for action port [ 621.884847] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4cf2be4-c286-4874-bcca-378edeb66616 with Priority: HIGHEST for action port [ 621.884847] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4cf2be4-c286-4874-bcca-378edeb66616 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.885131] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4cf2be4-c286-4874-bcca-378edeb66616" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.885131] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4cf2be4-c286-4874-bcca-378edeb66616" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.886276] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4cf2be4-c286-4874-bcca-378edeb66616" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.886369] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4cf2be4-c286-4874-bcca-378edeb66616',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.966569] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8fb4d28c-13d7-48fd-b533-e7a002a7949d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.390862] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f4cf2be4-c286-4874-bcca-378edeb66616 [ 622.391774] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.391774] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.391774] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.391774] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.391774] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.392049] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f4cf2be4-c286-4874-bcca-378edeb66616 already deleted. [ 622.392049] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4cf2be4-c286-4874-bcca-378edeb66616" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.469889] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.470129] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.470234] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.470698] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.470872] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.471031] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fb4d28c-13d7-48fd-b533-e7a002a7949d is going to be created. [ 622.516347] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.516550] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.516589] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.516782] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.516942] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.540352] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fb4d28c-13d7-48fd-b533-e7a002a7949d in Status: UNINITIALIZED for 2s [ 622.810286] env[65783]: INFO networking_nsxv3.common.synchronization [None req-54b3c064-9813-4380-a397-a79d352ae111 None None] Enqueued Resource ID: 738dc5b8-4ab2-46fe-99f1-0afeb09389f9 with Priority: HIGHEST for action port [ 622.812015] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 738dc5b8-4ab2-46fe-99f1-0afeb09389f9 with Priority: HIGHEST for action port [ 622.812015] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-738dc5b8-4ab2-46fe-99f1-0afeb09389f9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.812015] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-738dc5b8-4ab2-46fe-99f1-0afeb09389f9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.812644] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-738dc5b8-4ab2-46fe-99f1-0afeb09389f9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.812644] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-738dc5b8-4ab2-46fe-99f1-0afeb09389f9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.812858] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('738dc5b8-4ab2-46fe-99f1-0afeb09389f9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.314853] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 738dc5b8-4ab2-46fe-99f1-0afeb09389f9 [ 623.315331] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.315331] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.315331] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.315512] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.315606] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.315717] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:738dc5b8-4ab2-46fe-99f1-0afeb09389f9 already deleted. [ 623.315770] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-738dc5b8-4ab2-46fe-99f1-0afeb09389f9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.585561] env[65783]: INFO networking_nsxv3.common.synchronization [None req-bae66c8f-dc31-43f8-b6ae-73a89c68bc24 None None] Enqueued Resource ID: 13eb61e3-b34d-493a-9efe-e9ee5ab90a1b with Priority: HIGHEST for action port [ 623.587214] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13eb61e3-b34d-493a-9efe-e9ee5ab90a1b with Priority: HIGHEST for action port [ 623.587681] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-13eb61e3-b34d-493a-9efe-e9ee5ab90a1b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.587916] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13eb61e3-b34d-493a-9efe-e9ee5ab90a1b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.588251] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13eb61e3-b34d-493a-9efe-e9ee5ab90a1b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.588383] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13eb61e3-b34d-493a-9efe-e9ee5ab90a1b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.588506] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13eb61e3-b34d-493a-9efe-e9ee5ab90a1b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.093623] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 13eb61e3-b34d-493a-9efe-e9ee5ab90a1b [ 624.093801] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.093930] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.094046] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.094228] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.094332] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.094428] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:13eb61e3-b34d-493a-9efe-e9ee5ab90a1b already deleted. [ 624.094503] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13eb61e3-b34d-493a-9efe-e9ee5ab90a1b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.554225] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fb4d28c-13d7-48fd-b533-e7a002a7949d in Status: SUCCESS [ 624.554575] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.554575] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.554784] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.555012] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.555148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.555214] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.555403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.555451] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.555531] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.555623] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8fb4d28c-13d7-48fd-b533-e7a002a7949d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.827395] env[65783]: INFO networking_nsxv3.common.synchronization [None req-62d9d592-dba3-4d75-9ed7-fa0e53ecdf90 None None] Enqueued Resource ID: 6dd6b269-1aa5-4941-9823-c03e8970977f with Priority: HIGHEST for action port [ 624.827395] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dd6b269-1aa5-4941-9823-c03e8970977f with Priority: HIGHEST for action port [ 624.827395] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-6dd6b269-1aa5-4941-9823-c03e8970977f taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.827395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6dd6b269-1aa5-4941-9823-c03e8970977f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.827395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6dd6b269-1aa5-4941-9823-c03e8970977f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.827395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6dd6b269-1aa5-4941-9823-c03e8970977f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.827395] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6dd6b269-1aa5-4941-9823-c03e8970977f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.991616] env[65783]: INFO networking_nsxv3.common.synchronization [req-05e8a4e2-ee8f-426d-b87a-0055f5be23b1 req-6911cb77-8b9e-4760-a4be-63a63d9f128a tempest-ImagesNegativeTestJSON-2006960124 tempest-ImagesNegativeTestJSON-2006960124-project-member] Enqueued Resource ID: dd42c762-b73d-4959-95b1-e671bccc381e with Priority: HIGHEST for action security_group_members [ 624.992509] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd42c762-b73d-4959-95b1-e671bccc381e with Priority: HIGHEST for action security_group_members [ 624.992509] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd42c762-b73d-4959-95b1-e671bccc381e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.992704] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.992704] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.992889] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.993709] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.994011] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.994097] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.994611] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.994611] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.994611] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd42c762-b73d-4959-95b1-e671bccc381e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.059129] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fb4d28c-13d7-48fd-b533-e7a002a7949d taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.059375] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.059434] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.059763] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.059951] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.060398] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.060398] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.060398] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.060398] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.060554] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.060620] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fb4d28c-13d7-48fd-b533-e7a002a7949d taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.060724] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.060788] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.060922] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.061067] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.061170] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.061227] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.061366] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.061440] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.061526] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.062463] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8fb4d28c-13d7-48fd-b533-e7a002a7949d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.333132] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6dd6b269-1aa5-4941-9823-c03e8970977f [ 625.334171] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.334171] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.334171] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.334171] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.334171] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.334171] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6dd6b269-1aa5-4941-9823-c03e8970977f already deleted. [ 625.334538] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6dd6b269-1aa5-4941-9823-c03e8970977f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.498027] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.498366] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.498444] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.499025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.499025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.499195] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.499305] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.499370] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.500901] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.500985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.501097] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd42c762-b73d-4959-95b1-e671bccc381e is going to be updated. [ 625.534742] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.534893] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.534982] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.535221] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.535462] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.545647] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd42c762-b73d-4959-95b1-e671bccc381e in Status: IN_PROGRESS for 2s [ 625.565078] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8fb4d28c-13d7-48fd-b533-e7a002a7949d: rpc.has_security_group_logging(os_id): False [ 625.583398] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.583398] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.583398] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.583601] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.583689] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.583868] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.584885] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.585088] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.585471] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.585471] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.585471] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.585630] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.585630] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.585771] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.586444] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.586444] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.586444] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.586444] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.586444] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.586444] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.586444] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8fb4d28c-13d7-48fd-b533-e7a002a7949d is going to be created. [ 625.648334] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.648487] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.649082] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.649082] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.649082] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.661689] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8fb4d28c-13d7-48fd-b533-e7a002a7949d in Status: IN_PROGRESS for 2s [ 626.041994] env[65783]: INFO networking_nsxv3.common.synchronization [req-4628dffb-d6cc-4fd6-b38d-148f07946953 req-1017bd44-a7d1-44eb-a86e-3195731e3ce2 tempest-ServersWithSpecificFlavorTestJSON-767212478 tempest-ServersWithSpecificFlavorTestJSON-767212478-project-member] Enqueued Resource ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 with Priority: HIGHEST for action security_group_members [ 626.042151] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 with Priority: HIGHEST for action security_group_members [ 626.042463] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e588ff7c-d45a-4b75-823e-f219eeb5e814 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.042600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.042761] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.042921] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.043085] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.043405] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.043405] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.044621] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.044621] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.044621] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e588ff7c-d45a-4b75-823e-f219eeb5e814',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.548244] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.548244] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.548244] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.548244] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.548244] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.548244] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.548244] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.548244] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.548244] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.548244] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.548244] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 already deleted. [ 626.548244] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.646950] env[65783]: INFO networking_nsxv3.common.synchronization [None req-794db6ce-89c2-4405-a16b-648d1ac135da None None] Enqueued Resource ID: f0bcc0c4-5390-4979-8a8e-92d67f7bd103 with Priority: HIGHEST for action port [ 626.647748] env[65783]: INFO networking_nsxv3.common.synchronization [None req-c23d16a3-9e88-4b16-aad0-e83932fb6169 None None] Enqueued Resource ID: 07d0c34e-132e-4ffe-bf6d-f172572d06c5 with Priority: HIGHEST for action port [ 626.648758] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0bcc0c4-5390-4979-8a8e-92d67f7bd103 with Priority: HIGHEST for action port [ 626.648758] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07d0c34e-132e-4ffe-bf6d-f172572d06c5 with Priority: HIGHEST for action port [ 626.648758] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0bcc0c4-5390-4979-8a8e-92d67f7bd103 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.648758] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0bcc0c4-5390-4979-8a8e-92d67f7bd103" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.648997] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0bcc0c4-5390-4979-8a8e-92d67f7bd103" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.649100] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0bcc0c4-5390-4979-8a8e-92d67f7bd103" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.649179] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0bcc0c4-5390-4979-8a8e-92d67f7bd103',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.650045] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-07d0c34e-132e-4ffe-bf6d-f172572d06c5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.650158] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07d0c34e-132e-4ffe-bf6d-f172572d06c5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.650218] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07d0c34e-132e-4ffe-bf6d-f172572d06c5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.650431] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07d0c34e-132e-4ffe-bf6d-f172572d06c5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.650504] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07d0c34e-132e-4ffe-bf6d-f172572d06c5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.817084] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-944 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.817313] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-944" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.817313] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-944" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.817812] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-944" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.818484] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.818655] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.818995] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.820060] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.820060] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.820060] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.820295] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 626.820361] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 626.820772] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 626.820772] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.820929] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 626.821080] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 626.844542] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 626.844860] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 626.845069] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 626.845683] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-944" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.845914] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-ca17fd35-e868-4f50-ac40-b6da3a12b015 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.848799] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-ca17fd35-e868-4f50-ac40-b6da3a12b015" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.850043] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-ca17fd35-e868-4f50-ac40-b6da3a12b015" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.850043] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-ca17fd35-e868-4f50-ac40-b6da3a12b015" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.850507] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca17fd35-e868-4f50-ac40-b6da3a12b015',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.152581] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f0bcc0c4-5390-4979-8a8e-92d67f7bd103 [ 627.152830] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.152974] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.153054] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.153276] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.153362] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.153452] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f0bcc0c4-5390-4979-8a8e-92d67f7bd103 already deleted. [ 627.153534] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0bcc0c4-5390-4979-8a8e-92d67f7bd103" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.153724] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 07d0c34e-132e-4ffe-bf6d-f172572d06c5 [ 627.153870] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.153973] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.154072] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.154277] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.154354] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.154460] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:07d0c34e-132e-4ffe-bf6d-f172572d06c5 already deleted. [ 627.154519] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07d0c34e-132e-4ffe-bf6d-f172572d06c5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.353052] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.353216] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.353311] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.353731] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.353731] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.353841] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port ca17fd35-e868-4f50-ac40-b6da3a12b015 not found, creating... [ 627.354129] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.354533] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.354533] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.354654] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.354719] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.355044] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.355163] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.355331] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.355482] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.355603] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.355732] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: ca17fd35-e868-4f50-ac40-b6da3a12b015 is going to be created. [ 627.385036] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.385036] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.385036] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.385036] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.385378] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.385423] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-ca17fd35-e868-4f50-ac40-b6da3a12b015" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.559518] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd42c762-b73d-4959-95b1-e671bccc381e in Status: SUCCESS [ 627.560225] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd42c762-b73d-4959-95b1-e671bccc381e deletion is rescheduled due to dependency. [ 627.560428] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.679136] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8fb4d28c-13d7-48fd-b533-e7a002a7949d in Status: SUCCESS [ 627.679136] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.176109] env[65783]: INFO networking_nsxv3.common.synchronization [req-4628dffb-d6cc-4fd6-b38d-148f07946953 req-2cfcd2df-8b0b-44f4-8a15-6aaa96ee90be service nova] Enqueued Resource ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 with Priority: HIGHEST for action security_group_rules [ 628.176284] env[65783]: INFO networking_nsxv3.common.synchronization [req-4628dffb-d6cc-4fd6-b38d-148f07946953 req-2cfcd2df-8b0b-44f4-8a15-6aaa96ee90be service nova] Enqueued Resource ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 with Priority: HIGHEST for action security_group_members [ 628.176430] env[65783]: INFO networking_nsxv3.common.synchronization [req-4628dffb-d6cc-4fd6-b38d-148f07946953 req-2cfcd2df-8b0b-44f4-8a15-6aaa96ee90be service nova] Enqueued Resource ID: ca17fd35-e868-4f50-ac40-b6da3a12b015 with Priority: HIGHEST for action port [ 628.176976] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 with Priority: HIGHEST for action security_group_rules [ 628.177129] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 with Priority: HIGHEST for action security_group_members [ 628.177226] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca17fd35-e868-4f50-ac40-b6da3a12b015 with Priority: HIGHEST for action port [ 628.177519] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e588ff7c-d45a-4b75-823e-f219eeb5e814 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.177677] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.177785] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.178022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.181446] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e588ff7c-d45a-4b75-823e-f219eeb5e814',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.186398] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e588ff7c-d45a-4b75-823e-f219eeb5e814 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.186398] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.186398] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.186398] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.186398] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.186398] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.186398] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.186398] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.186398] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.186398] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e588ff7c-d45a-4b75-823e-f219eeb5e814',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.190582] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca17fd35-e868-4f50-ac40-b6da3a12b015 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.190582] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca17fd35-e868-4f50-ac40-b6da3a12b015" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.190582] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca17fd35-e868-4f50-ac40-b6da3a12b015" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.190582] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca17fd35-e868-4f50-ac40-b6da3a12b015" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.190582] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca17fd35-e868-4f50-ac40-b6da3a12b015',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.691827] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e588ff7c-d45a-4b75-823e-f219eeb5e814 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.692231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.692294] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e588ff7c-d45a-4b75-823e-f219eeb5e814',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.693365] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ca17fd35-e868-4f50-ac40-b6da3a12b015 with status ACTIVE [ 628.693365] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.693557] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.693557] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.697657] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.697657] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.698290] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.698443] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.698520] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.699019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.700393] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.700393] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.700393] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.700393] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.700393] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.700393] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.700393] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ca17fd35-e868-4f50-ac40-b6da3a12b015 is going to be updated. [ 628.726321] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.726321] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.726321] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.726321] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.726321] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.726321] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca17fd35-e868-4f50-ac40-b6da3a12b015" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.203491] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e588ff7c-d45a-4b75-823e-f219eeb5e814',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.273878] env[65783]: INFO networking_nsxv3.common.synchronization [req-8dd0c206-ccc5-4011-a1eb-da64b2decb3b req-5e4c92ec-e6e5-4b02-aaf0-6bf89e0c7d15 tempest-ServerDiagnosticsTest-1881811713 tempest-ServerDiagnosticsTest-1881811713-project-member] Enqueued Resource ID: 0c4389af-195b-4eda-a15f-a441817ee12a with Priority: HIGHEST for action security_group_members [ 629.273878] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4389af-195b-4eda-a15f-a441817ee12a with Priority: HIGHEST for action security_group_members [ 629.273968] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4389af-195b-4eda-a15f-a441817ee12a taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.276019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.276117] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.276331] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.276526] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.276637] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.276701] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.276865] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.276952] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.277071] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4389af-195b-4eda-a15f-a441817ee12a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.467884] env[65783]: INFO networking_nsxv3.common.synchronization [None req-515ad18a-dd55-4f2e-8924-40c674e31121 None None] Enqueued Resource ID: 6ca65336-bf2b-4353-9c52-818af402b54c with Priority: HIGHEST for action port [ 629.467884] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ca65336-bf2b-4353-9c52-818af402b54c with Priority: HIGHEST for action port [ 629.467884] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ca65336-bf2b-4353-9c52-818af402b54c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.467884] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ca65336-bf2b-4353-9c52-818af402b54c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.467884] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ca65336-bf2b-4353-9c52-818af402b54c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.468202] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ca65336-bf2b-4353-9c52-818af402b54c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.468289] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ca65336-bf2b-4353-9c52-818af402b54c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.707629] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.708034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.708034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.709036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.709036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.709036] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 is going to be created. [ 629.742047] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.742047] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.742047] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.742047] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.742047] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.756996] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 in Status: UNINITIALIZED for 2s [ 629.779702] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.779947] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.780053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.780309] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.780414] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.782324] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.782324] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.782324] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.782324] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.782324] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.782324] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4389af-195b-4eda-a15f-a441817ee12a is going to be updated. [ 629.839223] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.839397] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.839469] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.839662] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.839913] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.854870] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4389af-195b-4eda-a15f-a441817ee12a in Status: IN_PROGRESS for 2s [ 629.972022] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ca65336-bf2b-4353-9c52-818af402b54c [ 629.972022] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.972022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.972022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.972022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.972022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.972022] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ca65336-bf2b-4353-9c52-818af402b54c already deleted. [ 629.972022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ca65336-bf2b-4353-9c52-818af402b54c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.014432] env[65783]: INFO networking_nsxv3.common.synchronization [None req-a6d4b32d-970d-4541-b427-68e73bdc2d5b None None] Enqueued Resource ID: 74b4d458-1cd0-437b-956b-463e0f33a4fe with Priority: HIGHEST for action port [ 631.015048] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74b4d458-1cd0-437b-956b-463e0f33a4fe with Priority: HIGHEST for action port [ 631.015386] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-74b4d458-1cd0-437b-956b-463e0f33a4fe taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.015524] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74b4d458-1cd0-437b-956b-463e0f33a4fe" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.015567] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74b4d458-1cd0-437b-956b-463e0f33a4fe" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.015848] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74b4d458-1cd0-437b-956b-463e0f33a4fe" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.015932] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74b4d458-1cd0-437b-956b-463e0f33a4fe',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.519581] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74b4d458-1cd0-437b-956b-463e0f33a4fe [ 631.519581] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.519581] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.519581] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.519581] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.519581] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.519581] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74b4d458-1cd0-437b-956b-463e0f33a4fe already deleted. [ 631.519581] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74b4d458-1cd0-437b-956b-463e0f33a4fe" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.664040] env[65783]: INFO networking_nsxv3.common.synchronization [None req-fbdf1df1-a805-4502-9eea-2c2676592e80 None None] Enqueued Resource ID: f7a3b04d-56bb-4c57-86bf-3790a9155d5b with Priority: HIGHEST for action port [ 631.668429] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7a3b04d-56bb-4c57-86bf-3790a9155d5b with Priority: HIGHEST for action port [ 631.668920] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7a3b04d-56bb-4c57-86bf-3790a9155d5b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.668920] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7a3b04d-56bb-4c57-86bf-3790a9155d5b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.669052] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7a3b04d-56bb-4c57-86bf-3790a9155d5b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.672460] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7a3b04d-56bb-4c57-86bf-3790a9155d5b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.672460] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7a3b04d-56bb-4c57-86bf-3790a9155d5b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.771269] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 in Status: SUCCESS [ 631.771269] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.771269] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.771269] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.771269] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.771269] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.771269] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.771269] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.771575] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.771575] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.771575] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e588ff7c-d45a-4b75-823e-f219eeb5e814',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.866826] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4389af-195b-4eda-a15f-a441817ee12a in Status: SUCCESS [ 631.867462] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4389af-195b-4eda-a15f-a441817ee12a deletion is rescheduled due to dependency. [ 631.867462] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.170999] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f7a3b04d-56bb-4c57-86bf-3790a9155d5b [ 632.171400] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.173108] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.173108] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.173108] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.173108] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.173108] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f7a3b04d-56bb-4c57-86bf-3790a9155d5b already deleted. [ 632.173108] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7a3b04d-56bb-4c57-86bf-3790a9155d5b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.275436] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e588ff7c-d45a-4b75-823e-f219eeb5e814',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.778874] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e588ff7c-d45a-4b75-823e-f219eeb5e814: rpc.has_security_group_logging(os_id): False [ 632.875324] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.875525] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.875618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.875920] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.876044] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.876379] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.876514] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.876600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.877418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.877418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.877418] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 is going to be created. [ 632.988528] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.988665] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.988710] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.988957] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.989154] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.008040] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 in Status: IN_PROGRESS for 2s [ 633.108174] env[65783]: INFO networking_nsxv3.common.synchronization [req-853033fb-71d5-4354-b4a4-1cfabfcd77d5 req-d1b78241-6755-45bb-b7fb-f1442f1a7b2a tempest-ServersAdminTestJSON-345343376 tempest-ServersAdminTestJSON-345343376-project-member] Enqueued Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_members [ 633.108174] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_members [ 633.108174] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca99b1a6-3702-4011-942b-06036fda2165 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.108174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.108174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.108174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.108174] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.108174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.108174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.108997] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.109335] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.109594] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.537208] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-714 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.537513] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-714" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.537615] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-714" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.537948] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-714" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.538218] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.538372] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.538482] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.538687] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.538817] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.539848] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 633.540865] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 633.544230] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 633.544230] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 633.544230] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 633.544230] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 633.544230] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 633.567077] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 633.567077] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 633.567077] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 633.567077] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-714" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.567077] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-1b0ec4f3-be92-493e-a8ed-6af0f0bb844c taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.567077] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-1b0ec4f3-be92-493e-a8ed-6af0f0bb844c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.567077] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-1b0ec4f3-be92-493e-a8ed-6af0f0bb844c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.567077] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-1b0ec4f3-be92-493e-a8ed-6af0f0bb844c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.567077] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b0ec4f3-be92-493e-a8ed-6af0f0bb844c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.613908] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.613908] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.614210] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.614351] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.614467] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.614859] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.614859] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.615090] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.615181] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.615273] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.615379] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca99b1a6-3702-4011-942b-06036fda2165 already deleted. [ 633.615808] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.783290] env[65783]: INFO networking_nsxv3.common.synchronization [None req-08b006fa-3a07-4c98-8661-b8efc872d9d5 None None] Enqueued Resource ID: 36c187c5-c6d3-4f3a-9bdf-e7b02375d7f7 with Priority: HIGHEST for action port [ 633.783560] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36c187c5-c6d3-4f3a-9bdf-e7b02375d7f7 with Priority: HIGHEST for action port [ 633.784302] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-36c187c5-c6d3-4f3a-9bdf-e7b02375d7f7 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.784460] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36c187c5-c6d3-4f3a-9bdf-e7b02375d7f7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.784540] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36c187c5-c6d3-4f3a-9bdf-e7b02375d7f7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.784816] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36c187c5-c6d3-4f3a-9bdf-e7b02375d7f7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.784929] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36c187c5-c6d3-4f3a-9bdf-e7b02375d7f7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.074029] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.074029] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.074029] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.074029] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.074029] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.074029] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 1b0ec4f3-be92-493e-a8ed-6af0f0bb844c not found, creating... [ 634.074029] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.074029] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.074029] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.074029] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.074029] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.074622] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.074622] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.074785] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.075189] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.075553] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.075833] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 1b0ec4f3-be92-493e-a8ed-6af0f0bb844c is going to be created. [ 634.100719] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.100719] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.100719] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.100719] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.101055] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.101220] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-1b0ec4f3-be92-493e-a8ed-6af0f0bb844c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.287666] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 36c187c5-c6d3-4f3a-9bdf-e7b02375d7f7 [ 634.287834] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.288054] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.288139] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.288371] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.288438] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.288541] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:36c187c5-c6d3-4f3a-9bdf-e7b02375d7f7 already deleted. [ 634.288621] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36c187c5-c6d3-4f3a-9bdf-e7b02375d7f7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.835250] env[65783]: INFO networking_nsxv3.common.synchronization [req-1b8e67e8-0b2f-459c-ad4c-703cc738a589 req-9c3147cd-ed45-4f32-a7af-2415bfac65ee tempest-ServerExternalEventsTest-1308199313 tempest-ServerExternalEventsTest-1308199313-project-member] Enqueued Resource ID: 85cfbc91-333d-4a17-874c-c9f26dffaadd with Priority: HIGHEST for action security_group_members [ 634.835250] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cfbc91-333d-4a17-874c-c9f26dffaadd with Priority: HIGHEST for action security_group_members [ 634.836153] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cfbc91-333d-4a17-874c-c9f26dffaadd taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.836500] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.836689] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.836988] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.837285] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.837543] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.837700] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.838031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.838254] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.838538] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85cfbc91-333d-4a17-874c-c9f26dffaadd',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.909271] env[65783]: INFO networking_nsxv3.common.synchronization [req-853033fb-71d5-4354-b4a4-1cfabfcd77d5 req-0c0f8cf1-701d-4bc5-9ac1-999c760bbc43 service nova] Enqueued Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_rules [ 634.909448] env[65783]: INFO networking_nsxv3.common.synchronization [req-853033fb-71d5-4354-b4a4-1cfabfcd77d5 req-0c0f8cf1-701d-4bc5-9ac1-999c760bbc43 service nova] Enqueued Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_members [ 634.909576] env[65783]: INFO networking_nsxv3.common.synchronization [req-853033fb-71d5-4354-b4a4-1cfabfcd77d5 req-0c0f8cf1-701d-4bc5-9ac1-999c760bbc43 service nova] Enqueued Resource ID: 1b0ec4f3-be92-493e-a8ed-6af0f0bb844c with Priority: HIGHEST for action port [ 634.910339] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_rules [ 634.910560] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_members [ 634.910674] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b0ec4f3-be92-493e-a8ed-6af0f0bb844c with Priority: HIGHEST for action port [ 634.912694] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca99b1a6-3702-4011-942b-06036fda2165 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.912834] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.912896] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.913219] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.913273] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.914299] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca99b1a6-3702-4011-942b-06036fda2165 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.914423] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.914490] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.915618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.915618] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.915618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.915618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.915618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.915618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.915618] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.921510] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b0ec4f3-be92-493e-a8ed-6af0f0bb844c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.921510] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b0ec4f3-be92-493e-a8ed-6af0f0bb844c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.921510] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b0ec4f3-be92-493e-a8ed-6af0f0bb844c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.921510] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b0ec4f3-be92-493e-a8ed-6af0f0bb844c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.921510] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b0ec4f3-be92-493e-a8ed-6af0f0bb844c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.022510] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 in Status: SUCCESS [ 635.022767] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.136804] env[65783]: INFO networking_nsxv3.common.synchronization [None req-e3f0b6d6-62f5-484a-9707-2ea8aed55213 None None] Enqueued Resource ID: d8aefebd-50a2-4cec-bc16-0b208f7abc3d with Priority: HIGHEST for action port [ 635.137702] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8aefebd-50a2-4cec-bc16-0b208f7abc3d with Priority: HIGHEST for action port [ 635.138348] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8aefebd-50a2-4cec-bc16-0b208f7abc3d taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.138460] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8aefebd-50a2-4cec-bc16-0b208f7abc3d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.138460] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8aefebd-50a2-4cec-bc16-0b208f7abc3d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.138726] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8aefebd-50a2-4cec-bc16-0b208f7abc3d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.138818] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8aefebd-50a2-4cec-bc16-0b208f7abc3d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.341805] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.341805] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.341805] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.342566] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.342704] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.343012] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.343112] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.343112] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.343294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.343377] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.343471] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cfbc91-333d-4a17-874c-c9f26dffaadd is going to be updated. [ 635.396667] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.396667] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.396667] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.396667] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.396667] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.407395] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cfbc91-333d-4a17-874c-c9f26dffaadd in Status: IN_PROGRESS for 2s [ 635.422535] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.424316] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca99b1a6-3702-4011-942b-06036fda2165 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.424316] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.429532] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1b0ec4f3-be92-493e-a8ed-6af0f0bb844c with status ACTIVE [ 635.429613] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.429741] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.429785] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.430155] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.430155] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.430306] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.430543] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.430543] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.430630] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.431908] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.431908] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.431908] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.431908] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.432143] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.432143] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.432220] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1b0ec4f3-be92-493e-a8ed-6af0f0bb844c is going to be updated. [ 635.458085] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.458363] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.458461] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.458693] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.458851] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.459074] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b0ec4f3-be92-493e-a8ed-6af0f0bb844c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.642235] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d8aefebd-50a2-4cec-bc16-0b208f7abc3d [ 635.642235] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.642235] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.642235] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.642235] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.642639] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.642639] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d8aefebd-50a2-4cec-bc16-0b208f7abc3d already deleted. [ 635.642639] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8aefebd-50a2-4cec-bc16-0b208f7abc3d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.833738] env[65783]: INFO networking_nsxv3.common.synchronization [req-5d6595f3-ee4e-4140-b635-fd37deae1481 req-5ddb1546-6d62-4080-a88e-bed7514d25ce tempest-ServerDiagnosticsNegativeTest-336669837 tempest-ServerDiagnosticsNegativeTest-336669837-project-member] Enqueued Resource ID: 5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 with Priority: HIGHEST for action security_group_members [ 635.833995] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 with Priority: HIGHEST for action security_group_members [ 635.834362] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.834501] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.834548] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.834785] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.834937] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.835207] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.835260] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.835674] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.835893] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.836327] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.925409] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.174191] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-251 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.174389] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.174511] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.174780] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.175061] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.175219] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.175331] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.175540] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.175676] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.175869] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 636.175976] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 636.176757] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 636.176922] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 636.177078] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 636.177212] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 636.177360] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 636.210081] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 636.210293] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 636.210520] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 636.210660] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.211019] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-528d3b24-3631-4afa-af44-515f60a2df2c taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.211378] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-528d3b24-3631-4afa-af44-515f60a2df2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.211456] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-528d3b24-3631-4afa-af44-515f60a2df2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.211722] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-528d3b24-3631-4afa-af44-515f60a2df2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.211861] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('528d3b24-3631-4afa-af44-515f60a2df2c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.338961] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.339172] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.339219] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.339424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.339515] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.339709] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.339806] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.339895] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.340062] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.340140] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.340222] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 already deleted. [ 636.340300] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.429095] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.429095] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.429095] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.429301] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.429379] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.429747] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca99b1a6-3702-4011-942b-06036fda2165 is going to be created. [ 636.457382] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.457382] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.457382] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.457382] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.457382] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.467889] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: UNINITIALIZED for 2s [ 636.715476] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.715476] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.715919] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.715919] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.716043] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.716179] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 528d3b24-3631-4afa-af44-515f60a2df2c not found, creating... [ 636.716447] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.716595] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.716730] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.717026] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.717070] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.717422] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.717597] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.717690] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.718598] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.718598] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.718598] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 528d3b24-3631-4afa-af44-515f60a2df2c is going to be created. [ 636.741660] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.741918] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.742651] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.742760] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.743026] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.743313] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-528d3b24-3631-4afa-af44-515f60a2df2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.424430] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cfbc91-333d-4a17-874c-c9f26dffaadd in Status: SUCCESS [ 637.424706] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cfbc91-333d-4a17-874c-c9f26dffaadd deletion is rescheduled due to dependency. [ 637.424750] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.562315] env[65783]: INFO networking_nsxv3.common.synchronization [req-5d6595f3-ee4e-4140-b635-fd37deae1481 req-17284725-10cf-4e00-b060-e24850b5fd1e service nova] Enqueued Resource ID: 5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 with Priority: HIGHEST for action security_group_rules [ 637.562315] env[65783]: INFO networking_nsxv3.common.synchronization [req-5d6595f3-ee4e-4140-b635-fd37deae1481 req-17284725-10cf-4e00-b060-e24850b5fd1e service nova] Enqueued Resource ID: 5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 with Priority: HIGHEST for action security_group_members [ 637.562315] env[65783]: INFO networking_nsxv3.common.synchronization [req-5d6595f3-ee4e-4140-b635-fd37deae1481 req-17284725-10cf-4e00-b060-e24850b5fd1e service nova] Enqueued Resource ID: 528d3b24-3631-4afa-af44-515f60a2df2c with Priority: HIGHEST for action port [ 637.562315] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 with Priority: HIGHEST for action security_group_rules [ 637.562315] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 with Priority: HIGHEST for action security_group_members [ 637.562315] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 528d3b24-3631-4afa-af44-515f60a2df2c with Priority: HIGHEST for action port [ 637.563068] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.563206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.563265] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.563559] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.563646] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.565163] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.565304] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.565365] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.565577] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.565761] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.565864] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.565928] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.568044] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.568150] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.568270] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.569887] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-528d3b24-3631-4afa-af44-515f60a2df2c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.569887] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-528d3b24-3631-4afa-af44-515f60a2df2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.569887] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-528d3b24-3631-4afa-af44-515f60a2df2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.569887] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-528d3b24-3631-4afa-af44-515f60a2df2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.569887] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('528d3b24-3631-4afa-af44-515f60a2df2c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.071439] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.071661] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.073183] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 528d3b24-3631-4afa-af44-515f60a2df2c with status ACTIVE [ 638.073183] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.073378] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.073431] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.073718] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.073866] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.074021] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.074120] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.074188] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.074356] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.074427] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.074624] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.074713] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.074769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.074918] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.074986] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.075078] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 528d3b24-3631-4afa-af44-515f60a2df2c is going to be updated. [ 638.079319] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.106776] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.107068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.107183] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.107501] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.107678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.107910] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-528d3b24-3631-4afa-af44-515f60a2df2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.479587] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: SUCCESS [ 638.479913] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.480109] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.480866] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.480866] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.480866] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.480866] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.480866] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.481103] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.481103] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.481171] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.582106] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.983821] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca99b1a6-3702-4011-942b-06036fda2165 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.984027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.984120] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.984279] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.984956] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.984956] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.984956] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.984956] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.984956] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.984956] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.985513] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca99b1a6-3702-4011-942b-06036fda2165 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.985513] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.985513] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.985513] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.985713] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.986545] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.986708] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.989386] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.989386] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.989386] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.989386] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.084615] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.084836] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.084836] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.085497] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.085497] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.085497] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 is going to be created. [ 639.113657] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.115261] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.115261] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.115261] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.115261] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.129530] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 in Status: UNINITIALIZED for 2s [ 639.494243] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca99b1a6-3702-4011-942b-06036fda2165: rpc.has_security_group_logging(os_id): False [ 639.516636] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.516636] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.516636] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.516840] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.516881] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.517066] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.517172] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.517234] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.517386] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.517461] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.517646] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.517786] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.517824] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.517969] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.518103] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.518238] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.518330] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.518388] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.518524] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.518595] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.518676] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca99b1a6-3702-4011-942b-06036fda2165 is going to be created. [ 639.579593] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.579766] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.579804] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.580126] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.580309] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.593686] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: IN_PROGRESS for 2s [ 641.147066] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 in Status: SUCCESS [ 641.147066] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.147066] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.147066] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.147066] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.147066] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.147066] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.147066] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.147066] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.147066] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.147066] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.262327] env[65783]: INFO networking_nsxv3.common.synchronization [None req-0d722e0e-48d2-4b92-a365-fbff69f67129 None None] Enqueued Resource ID: bc112a84-b937-4164-8972-379ac8167836 with Priority: HIGHEST for action port [ 641.263181] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc112a84-b937-4164-8972-379ac8167836 with Priority: HIGHEST for action port [ 641.263181] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc112a84-b937-4164-8972-379ac8167836 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.263181] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc112a84-b937-4164-8972-379ac8167836" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.263181] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc112a84-b937-4164-8972-379ac8167836" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.264267] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc112a84-b937-4164-8972-379ac8167836" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.264490] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc112a84-b937-4164-8972-379ac8167836',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.607797] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: SUCCESS [ 641.608115] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.648847] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.649023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.649096] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.649374] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.650196] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.650344] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.650442] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.650605] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.650695] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.650788] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.651050] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.651246] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.651246] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.651483] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.651542] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.651640] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.651699] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.651839] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.651922] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.652010] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.652107] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.767364] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc112a84-b937-4164-8972-379ac8167836 [ 641.767364] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.767364] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.767364] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.768392] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.768392] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.768392] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc112a84-b937-4164-8972-379ac8167836 already deleted. [ 641.768392] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc112a84-b937-4164-8972-379ac8167836" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.159766] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40: rpc.has_security_group_logging(os_id): False [ 642.180607] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.180755] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.180814] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.181044] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.181126] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.181316] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.181423] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.181481] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.181636] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.181711] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.181932] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.182046] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.182101] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.182240] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.182312] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.182502] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.182594] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.183914] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.184140] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.184223] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.184340] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 is going to be created. [ 642.251196] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.251429] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.251429] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.251697] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.251811] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.264485] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 in Status: IN_PROGRESS for 2s [ 643.937421] env[65783]: INFO networking_nsxv3.common.synchronization [None req-ea486cdd-e713-49b5-9568-a9ed7527d9c7 None None] Enqueued Resource ID: 40c97fc5-f8b0-4543-a93c-404fd23c95b0 with Priority: HIGHEST for action port [ 643.938228] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40c97fc5-f8b0-4543-a93c-404fd23c95b0 with Priority: HIGHEST for action port [ 643.938350] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-40c97fc5-f8b0-4543-a93c-404fd23c95b0 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.938444] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40c97fc5-f8b0-4543-a93c-404fd23c95b0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.938517] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40c97fc5-f8b0-4543-a93c-404fd23c95b0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.938753] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40c97fc5-f8b0-4543-a93c-404fd23c95b0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.938845] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40c97fc5-f8b0-4543-a93c-404fd23c95b0',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.280657] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 in Status: SUCCESS [ 644.280953] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.445226] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 40c97fc5-f8b0-4543-a93c-404fd23c95b0 [ 644.445450] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.445587] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.445649] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.446359] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.446359] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.446359] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:40c97fc5-f8b0-4543-a93c-404fd23c95b0 already deleted. [ 644.446359] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40c97fc5-f8b0-4543-a93c-404fd23c95b0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.535538] env[65783]: INFO networking_nsxv3.common.synchronization [None req-2c761473-936f-4fd0-96ff-0636c6383256 None None] Enqueued Resource ID: ae4af0c1-c1c5-487a-b3f4-3a4b4feb6e85 with Priority: HIGHEST for action port [ 644.538034] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae4af0c1-c1c5-487a-b3f4-3a4b4feb6e85 with Priority: HIGHEST for action port [ 644.538034] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae4af0c1-c1c5-487a-b3f4-3a4b4feb6e85 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.538034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae4af0c1-c1c5-487a-b3f4-3a4b4feb6e85" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.538034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae4af0c1-c1c5-487a-b3f4-3a4b4feb6e85" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.538034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae4af0c1-c1c5-487a-b3f4-3a4b4feb6e85" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.538034] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae4af0c1-c1c5-487a-b3f4-3a4b4feb6e85',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.040517] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ae4af0c1-c1c5-487a-b3f4-3a4b4feb6e85 [ 645.041053] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.041053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.041233] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.041817] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.041939] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.042026] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ae4af0c1-c1c5-487a-b3f4-3a4b4feb6e85 already deleted. [ 645.042190] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae4af0c1-c1c5-487a-b3f4-3a4b4feb6e85" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.728090] env[65783]: INFO networking_nsxv3.common.synchronization [req-d042b093-8960-4703-8ed6-2ba9ce2cda88 req-9ba662d0-7c80-4246-b79f-6f46091f0f3e tempest-ServersAdminTestJSON-345343376 tempest-ServersAdminTestJSON-345343376-project-member] Enqueued Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_members [ 645.728679] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_members [ 645.729104] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca99b1a6-3702-4011-942b-06036fda2165 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.733354] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.733475] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.734299] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.734299] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.734299] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.734299] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.734824] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.734824] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.734824] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.238823] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.257027] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-714 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.257164] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-714" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.257285] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-714" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.257653] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-714" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.258125] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.258304] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.258918] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.259188] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.259363] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.259627] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 646.259802] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 646.260133] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 646.260261] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 646.260417] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 646.260585] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 646.260760] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 646.288306] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 646.288634] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 646.289604] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 646.289920] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-714" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.290663] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-4a2afbad-2811-48fa-aee9-aeefd31b60d1 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.290986] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-4a2afbad-2811-48fa-aee9-aeefd31b60d1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.291369] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-4a2afbad-2811-48fa-aee9-aeefd31b60d1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.291763] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-4a2afbad-2811-48fa-aee9-aeefd31b60d1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.291994] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a2afbad-2811-48fa-aee9-aeefd31b60d1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.741344] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.781529] env[65783]: INFO networking_nsxv3.common.synchronization [req-c80a1eec-890a-4ae4-a604-4facd1459d64 req-23270da0-4a74-4fd3-89a5-e28a789d160e tempest-TenantUsagesTestJSON-1133126431 tempest-TenantUsagesTestJSON-1133126431-project-member] Enqueued Resource ID: 8fb4d28c-13d7-48fd-b533-e7a002a7949d with Priority: HIGHEST for action security_group_members [ 646.783031] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fb4d28c-13d7-48fd-b533-e7a002a7949d with Priority: HIGHEST for action security_group_members [ 646.783031] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fb4d28c-13d7-48fd-b533-e7a002a7949d taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.783031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.783031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.783031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.784466] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.784582] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.784651] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.784825] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.784916] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.785023] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fb4d28c-13d7-48fd-b533-e7a002a7949d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.795276] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.796061] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.796061] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.796061] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.796902] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.796902] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 4a2afbad-2811-48fa-aee9-aeefd31b60d1 not found, creating... [ 646.796902] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.797245] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.797245] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.797432] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.797569] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.797927] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.798107] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.798219] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.798446] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.798575] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.798711] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 4a2afbad-2811-48fa-aee9-aeefd31b60d1 is going to be created. [ 646.832398] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.832689] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.832875] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.833219] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.833462] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.833696] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-4a2afbad-2811-48fa-aee9-aeefd31b60d1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.163461] env[65783]: INFO networking_nsxv3.common.synchronization [None req-8df90ef3-8c61-4683-9daa-aae61e7a2fd8 None None] Enqueued Resource ID: a3babe58-489f-4d38-9032-a1a96d43b9f2 with Priority: HIGHEST for action port [ 647.164231] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3babe58-489f-4d38-9032-a1a96d43b9f2 with Priority: HIGHEST for action port [ 647.164825] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3babe58-489f-4d38-9032-a1a96d43b9f2 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.164825] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3babe58-489f-4d38-9032-a1a96d43b9f2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.165099] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3babe58-489f-4d38-9032-a1a96d43b9f2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.165175] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3babe58-489f-4d38-9032-a1a96d43b9f2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.165267] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3babe58-489f-4d38-9032-a1a96d43b9f2',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.244106] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.244500] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.244500] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.244615] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.244671] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.244725] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca99b1a6-3702-4011-942b-06036fda2165 is going to be updated. [ 647.280397] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.280834] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.280834] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.280834] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.280978] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.287896] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.288095] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.288155] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.288385] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.288477] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.288721] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.288823] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.288867] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.289045] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.289126] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.289331] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fb4d28c-13d7-48fd-b533-e7a002a7949d is going to be updated. [ 647.292932] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: IN_PROGRESS for 2s [ 647.321684] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.321825] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.321890] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.322141] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.322286] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.333325] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fb4d28c-13d7-48fd-b533-e7a002a7949d in Status: IN_PROGRESS for 2s [ 647.606627] env[65783]: INFO networking_nsxv3.common.synchronization [req-d042b093-8960-4703-8ed6-2ba9ce2cda88 req-4f366da9-9cf3-4869-9751-2d3f98d3657b service nova] Enqueued Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_rules [ 647.606810] env[65783]: INFO networking_nsxv3.common.synchronization [req-d042b093-8960-4703-8ed6-2ba9ce2cda88 req-4f366da9-9cf3-4869-9751-2d3f98d3657b service nova] Enqueued Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_members [ 647.606934] env[65783]: INFO networking_nsxv3.common.synchronization [req-d042b093-8960-4703-8ed6-2ba9ce2cda88 req-4f366da9-9cf3-4869-9751-2d3f98d3657b service nova] Enqueued Resource ID: 4a2afbad-2811-48fa-aee9-aeefd31b60d1 with Priority: HIGHEST for action port [ 647.607702] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_rules [ 647.607849] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_members [ 647.608471] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a2afbad-2811-48fa-aee9-aeefd31b60d1 with Priority: HIGHEST for action port [ 647.608471] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca99b1a6-3702-4011-942b-06036fda2165 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.608694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.608694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.609171] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.609171] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.610336] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca99b1a6-3702-4011-942b-06036fda2165 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.610437] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.610627] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a2afbad-2811-48fa-aee9-aeefd31b60d1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.610722] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a2afbad-2811-48fa-aee9-aeefd31b60d1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.610783] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a2afbad-2811-48fa-aee9-aeefd31b60d1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.610982] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a2afbad-2811-48fa-aee9-aeefd31b60d1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.613363] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a2afbad-2811-48fa-aee9-aeefd31b60d1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.667481] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a3babe58-489f-4d38-9032-a1a96d43b9f2 [ 647.667791] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.667969] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.667969] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.668300] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.668394] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.668511] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a3babe58-489f-4d38-9032-a1a96d43b9f2 already deleted. [ 647.668634] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3babe58-489f-4d38-9032-a1a96d43b9f2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.113558] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca99b1a6-3702-4011-942b-06036fda2165 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.113737] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.114115] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a2afbad-2811-48fa-aee9-aeefd31b60d1 with status ACTIVE [ 648.114115] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.114258] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.114258] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.118342] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.118342] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.118501] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.118629] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.118674] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.118853] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.118936] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.119252] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.119375] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.119440] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.119655] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.119735] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.119823] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a2afbad-2811-48fa-aee9-aeefd31b60d1 is going to be updated. [ 648.150453] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.150592] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.150658] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.150913] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.151067] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.151247] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a2afbad-2811-48fa-aee9-aeefd31b60d1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.420654] env[65783]: INFO networking_nsxv3.common.synchronization [req-617256eb-2967-431a-88d8-e84594d93dc0 req-6643086a-c5e5-4da1-a379-b0acc8957100 tempest-FloatingIPsAssociationNegativeTestJSON-2090197600 tempest-FloatingIPsAssociationNegativeTestJSON-2090197600-project-member] Enqueued Resource ID: 40fa215c-6810-4862-9ddc-1bca888b2ee5 with Priority: HIGHEST for action security_group_members [ 648.421698] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40fa215c-6810-4862-9ddc-1bca888b2ee5 with Priority: HIGHEST for action security_group_members [ 648.422155] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-40fa215c-6810-4862-9ddc-1bca888b2ee5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.422413] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.422478] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.422723] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.422886] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.422999] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.423703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.423703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.423703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.423703] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40fa215c-6810-4862-9ddc-1bca888b2ee5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.914229] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-677 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.914534] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-677" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.914722] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-677" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.915199] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-677" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.915589] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.915820] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.915994] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.916331] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.916533] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.916917] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 648.917209] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 648.917295] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 648.917457] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 648.917594] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 648.917765] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 648.917965] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 648.928035] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.928035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.928035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.928035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.928035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.928035] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.928035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.928035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.928035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.928035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.928035] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40fa215c-6810-4862-9ddc-1bca888b2ee5 already deleted. [ 648.928035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.941521] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 648.941694] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 648.942934] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 648.942934] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-677" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.942934] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-6209b956-7cf9-4f9d-b25d-a36cca24051a taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.942934] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-6209b956-7cf9-4f9d-b25d-a36cca24051a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.942934] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-6209b956-7cf9-4f9d-b25d-a36cca24051a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.944384] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-6209b956-7cf9-4f9d-b25d-a36cca24051a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.944384] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6209b956-7cf9-4f9d-b25d-a36cca24051a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.322407] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: SUCCESS [ 649.322407] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.322407] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.322407] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.322407] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.322407] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.322407] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.322407] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.322407] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.322407] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.341687] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fb4d28c-13d7-48fd-b533-e7a002a7949d in Status: SUCCESS [ 649.342414] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fb4d28c-13d7-48fd-b533-e7a002a7949d deletion is rescheduled due to dependency. [ 649.342414] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.449256] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.449256] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.449256] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.449256] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.449256] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.449256] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 6209b956-7cf9-4f9d-b25d-a36cca24051a not found, creating... [ 649.449774] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.449774] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.449774] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.450033] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.450185] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.450468] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.450619] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.451514] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.451514] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.451514] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.451514] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 6209b956-7cf9-4f9d-b25d-a36cca24051a is going to be created. [ 649.474417] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.474650] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.474768] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.475200] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.475279] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.475502] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-6209b956-7cf9-4f9d-b25d-a36cca24051a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.824051] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.194646] env[65783]: INFO networking_nsxv3.common.synchronization [req-617256eb-2967-431a-88d8-e84594d93dc0 req-4edb85fc-2817-4cd6-bddd-03b7b5115d86 service nova] Enqueued Resource ID: 40fa215c-6810-4862-9ddc-1bca888b2ee5 with Priority: HIGHEST for action security_group_rules [ 650.194871] env[65783]: INFO networking_nsxv3.common.synchronization [req-617256eb-2967-431a-88d8-e84594d93dc0 req-4edb85fc-2817-4cd6-bddd-03b7b5115d86 service nova] Enqueued Resource ID: 40fa215c-6810-4862-9ddc-1bca888b2ee5 with Priority: HIGHEST for action security_group_members [ 650.194958] env[65783]: INFO networking_nsxv3.common.synchronization [req-617256eb-2967-431a-88d8-e84594d93dc0 req-4edb85fc-2817-4cd6-bddd-03b7b5115d86 service nova] Enqueued Resource ID: 6209b956-7cf9-4f9d-b25d-a36cca24051a with Priority: HIGHEST for action port [ 650.195490] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40fa215c-6810-4862-9ddc-1bca888b2ee5 with Priority: HIGHEST for action security_group_rules [ 650.195622] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40fa215c-6810-4862-9ddc-1bca888b2ee5 with Priority: HIGHEST for action security_group_members [ 650.195715] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6209b956-7cf9-4f9d-b25d-a36cca24051a with Priority: HIGHEST for action port [ 650.196228] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40fa215c-6810-4862-9ddc-1bca888b2ee5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.196581] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.196682] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.196984] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.197139] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40fa215c-6810-4862-9ddc-1bca888b2ee5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.198738] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-40fa215c-6810-4862-9ddc-1bca888b2ee5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.199649] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.199649] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.199890] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.200164] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.200433] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.200581] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.203802] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.203802] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.203802] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40fa215c-6810-4862-9ddc-1bca888b2ee5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.203802] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-6209b956-7cf9-4f9d-b25d-a36cca24051a taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.205507] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6209b956-7cf9-4f9d-b25d-a36cca24051a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.205994] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6209b956-7cf9-4f9d-b25d-a36cca24051a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.205994] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6209b956-7cf9-4f9d-b25d-a36cca24051a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.206343] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6209b956-7cf9-4f9d-b25d-a36cca24051a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.327222] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.708661] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-40fa215c-6810-4862-9ddc-1bca888b2ee5 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.708661] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.709192] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40fa215c-6810-4862-9ddc-1bca888b2ee5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.710174] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6209b956-7cf9-4f9d-b25d-a36cca24051a with status ACTIVE [ 650.710319] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.710517] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.710517] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.710702] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.710826] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.711053] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.711138] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.711189] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.711329] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.711380] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.711582] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.711668] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.712015] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.712015] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.712015] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.712015] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6209b956-7cf9-4f9d-b25d-a36cca24051a is going to be updated. [ 650.736515] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.737679] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.737679] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.737679] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.737951] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.738951] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6209b956-7cf9-4f9d-b25d-a36cca24051a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.830587] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.830838] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.830989] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.831320] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.831504] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.831666] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca99b1a6-3702-4011-942b-06036fda2165 is going to be updated. [ 650.871456] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.871605] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.871674] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.872539] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.872777] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.889461] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: IN_PROGRESS for 2s [ 651.214368] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40fa215c-6810-4862-9ddc-1bca888b2ee5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.717891] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.718229] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.718229] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.719396] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.720059] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.720317] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40fa215c-6810-4862-9ddc-1bca888b2ee5 is going to be created. [ 651.750509] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.750509] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.750671] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.751097] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.751097] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.765171] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40fa215c-6810-4862-9ddc-1bca888b2ee5 in Status: UNINITIALIZED for 2s [ 652.548758] env[65783]: INFO networking_nsxv3.common.synchronization [req-8cfc0252-631e-4af5-b5cb-eeaa66e3af71 req-722ac9a5-b2e4-454d-ae18-66cc265cf183 tempest-DeleteServersAdminTestJSON-1691143419 tempest-DeleteServersAdminTestJSON-1691143419-project-member] Enqueued Resource ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 with Priority: HIGHEST for action security_group_members [ 652.549424] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 with Priority: HIGHEST for action security_group_members [ 652.550477] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.550477] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.551136] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.551804] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.551804] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.551804] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.551804] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.552028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.552028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.552168] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.901139] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: SUCCESS [ 652.901501] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.901688] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.901920] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.902175] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.902273] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.902328] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.902623] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.902721] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.902824] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.903305] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.056141] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.056288] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.056373] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.056594] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.056717] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.056879] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.056972] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.057043] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.057179] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.057246] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.057326] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 is going to be updated. [ 653.088996] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.089150] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.089229] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.089428] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.089559] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.101238] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 in Status: IN_PROGRESS for 2s [ 653.352253] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-251 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.352435] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.352610] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.353213] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.353405] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.353658] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.353796] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.354042] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.354192] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.354421] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 653.354501] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 653.354602] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 653.354700] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 653.354809] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 653.354893] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 653.355041] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 653.380204] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 653.380204] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 653.380434] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 653.380479] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.380869] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-b6a744b9-f11d-4c57-8cbd-538c3c7d139c taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.381035] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-b6a744b9-f11d-4c57-8cbd-538c3c7d139c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.381081] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-b6a744b9-f11d-4c57-8cbd-538c3c7d139c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.381458] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-b6a744b9-f11d-4c57-8cbd-538c3c7d139c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.381588] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6a744b9-f11d-4c57-8cbd-538c3c7d139c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.406991] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca99b1a6-3702-4011-942b-06036fda2165 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.407203] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.407203] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.407585] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.407841] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.407958] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.408059] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.408242] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.408345] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.408456] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.408962] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca99b1a6-3702-4011-942b-06036fda2165 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.409101] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.409166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.409640] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.409983] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.410096] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.410176] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.410374] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.410451] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.410859] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.410940] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.780213] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40fa215c-6810-4862-9ddc-1bca888b2ee5 in Status: SUCCESS [ 653.780213] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.780213] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.780213] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.780213] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.780213] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.780213] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.780599] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.780599] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.780599] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.780981] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40fa215c-6810-4862-9ddc-1bca888b2ee5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.883971] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.885021] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.885225] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.886214] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.886431] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.886594] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port b6a744b9-f11d-4c57-8cbd-538c3c7d139c not found, creating... [ 653.886876] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.887038] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.887147] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.887559] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.887559] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.887829] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.888047] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.888170] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.888410] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.888505] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.888629] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: b6a744b9-f11d-4c57-8cbd-538c3c7d139c is going to be created. [ 653.912159] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.912460] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.912562] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.912809] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.913043] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.913263] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-b6a744b9-f11d-4c57-8cbd-538c3c7d139c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.914211] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca99b1a6-3702-4011-942b-06036fda2165: rpc.has_security_group_logging(os_id): False [ 653.937239] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.937239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.937239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.937239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.937239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.937239] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.937239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.937239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.937239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.937239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.937239] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.937239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.937239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.937239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.937239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.938136] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.938136] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.938136] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.938136] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.938136] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.938136] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca99b1a6-3702-4011-942b-06036fda2165 is going to be updated. [ 654.052578] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.052832] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.053153] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.053603] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.053958] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.072860] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: IN_PROGRESS for 2s [ 654.284015] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-40fa215c-6810-4862-9ddc-1bca888b2ee5 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.284015] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.284210] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.284763] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.284763] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.284763] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.284763] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.284952] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.285014] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.285064] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.285448] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-40fa215c-6810-4862-9ddc-1bca888b2ee5 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.285448] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.285448] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.285870] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.285870] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.285870] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.285870] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.286061] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.286061] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.286119] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.286193] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40fa215c-6810-4862-9ddc-1bca888b2ee5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.660197] env[65783]: INFO networking_nsxv3.common.synchronization [req-8cfc0252-631e-4af5-b5cb-eeaa66e3af71 req-58d6a6fa-9ede-485b-86bd-91527fc5e541 service nova] Enqueued Resource ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 with Priority: HIGHEST for action security_group_rules [ 654.660366] env[65783]: INFO networking_nsxv3.common.synchronization [req-8cfc0252-631e-4af5-b5cb-eeaa66e3af71 req-58d6a6fa-9ede-485b-86bd-91527fc5e541 service nova] Enqueued Resource ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 with Priority: HIGHEST for action security_group_members [ 654.661641] env[65783]: INFO networking_nsxv3.common.synchronization [req-8cfc0252-631e-4af5-b5cb-eeaa66e3af71 req-58d6a6fa-9ede-485b-86bd-91527fc5e541 service nova] Enqueued Resource ID: b6a744b9-f11d-4c57-8cbd-538c3c7d139c with Priority: HIGHEST for action port [ 654.664168] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 with Priority: HIGHEST for action security_group_rules [ 654.664527] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 with Priority: HIGHEST for action security_group_members [ 654.664527] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6a744b9-f11d-4c57-8cbd-538c3c7d139c with Priority: HIGHEST for action port [ 654.665981] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.666094] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.666173] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.667047] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.667047] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.667825] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.667924] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.668233] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6a744b9-f11d-4c57-8cbd-538c3c7d139c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.668418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6a744b9-f11d-4c57-8cbd-538c3c7d139c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.668547] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6a744b9-f11d-4c57-8cbd-538c3c7d139c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.668813] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6a744b9-f11d-4c57-8cbd-538c3c7d139c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.668904] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6a744b9-f11d-4c57-8cbd-538c3c7d139c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.789446] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40fa215c-6810-4862-9ddc-1bca888b2ee5: rpc.has_security_group_logging(os_id): False [ 654.809818] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.810146] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.810146] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.810382] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.810600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.810692] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.811667] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.811667] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.811667] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.811667] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.811667] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.811667] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.811667] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.811667] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.811667] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.812241] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.812241] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.812241] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.812241] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.812241] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.812241] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40fa215c-6810-4862-9ddc-1bca888b2ee5 is going to be created. [ 654.871317] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.871424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.871464] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.871689] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.871860] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.884022] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40fa215c-6810-4862-9ddc-1bca888b2ee5 in Status: IN_PROGRESS for 2s [ 655.117240] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 in Status: SUCCESS [ 655.117240] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 deletion is rescheduled due to dependency. [ 655.117240] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.117240] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.117634] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.117669] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.117865] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.117865] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.118015] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.118182] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.118278] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.171250] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.171387] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.172772] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b6a744b9-f11d-4c57-8cbd-538c3c7d139c with status ACTIVE [ 655.173031] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.173256] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.173415] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.173799] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.173968] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.174345] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.174648] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.174747] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.175109] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.175948] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.175948] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.175948] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.175948] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.175948] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.176214] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.176214] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b6a744b9-f11d-4c57-8cbd-538c3c7d139c is going to be updated. [ 655.200504] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.200715] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.200715] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.200917] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.201069] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.201275] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6a744b9-f11d-4c57-8cbd-538c3c7d139c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.622218] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.076291] env[65783]: INFO networking_nsxv3.common.synchronization [req-7f3ce582-838f-42ac-860d-61c8baa3957b req-b33c3134-c016-4d1c-86fe-5c9d9f91513d tempest-VolumesAdminNegativeTest-1754688451 tempest-VolumesAdminNegativeTest-1754688451-project-member] Enqueued Resource ID: 12b54335-eb35-490d-a8d9-d12ac5809eb9 with Priority: HIGHEST for action security_group_members [ 656.076964] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12b54335-eb35-490d-a8d9-d12ac5809eb9 with Priority: HIGHEST for action security_group_members [ 656.077664] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-12b54335-eb35-490d-a8d9-d12ac5809eb9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.077796] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.077859] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.078129] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.078306] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.078662] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.078662] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.078662] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.078794] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.078794] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12b54335-eb35-490d-a8d9-d12ac5809eb9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.091821] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: SUCCESS [ 656.092066] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.124483] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.582262] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.582647] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.584634] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.585310] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.585613] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.586936] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.586936] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.586936] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.586936] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.586936] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.586936] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12b54335-eb35-490d-a8d9-d12ac5809eb9 already deleted. [ 656.586936] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.627765] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.627879] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.627879] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.628204] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.628315] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.628416] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 is going to be updated. [ 656.666352] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.666805] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.666805] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.667042] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.667184] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.679076] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 in Status: IN_PROGRESS for 2s [ 656.901012] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40fa215c-6810-4862-9ddc-1bca888b2ee5 in Status: SUCCESS [ 656.901371] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.212324] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-690 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.212696] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-690" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.212696] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-690" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.212946] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-690" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.213211] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.213484] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.213604] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.213853] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.214031] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.214285] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.214428] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 657.214545] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 657.214645] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 657.214830] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.214904] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 657.215060] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 657.236184] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 657.237279] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 657.237279] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 657.237279] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-690" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.237279] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-48e98881-cbdc-4bbf-8b72-f5b3eaf5cc0b taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.237279] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-48e98881-cbdc-4bbf-8b72-f5b3eaf5cc0b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.237603] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-48e98881-cbdc-4bbf-8b72-f5b3eaf5cc0b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.237642] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-48e98881-cbdc-4bbf-8b72-f5b3eaf5cc0b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.238132] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48e98881-cbdc-4bbf-8b72-f5b3eaf5cc0b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.539472] env[65783]: INFO networking_nsxv3.common.synchronization [None req-c484615d-2c88-49e8-afba-e8d1d1ce082d None None] Enqueued Resource ID: f1023d5d-3a44-4b84-be62-2cd198cff4ff with Priority: HIGHEST for action port [ 657.539825] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1023d5d-3a44-4b84-be62-2cd198cff4ff with Priority: HIGHEST for action port [ 657.540317] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1023d5d-3a44-4b84-be62-2cd198cff4ff taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.540457] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1023d5d-3a44-4b84-be62-2cd198cff4ff" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.540533] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1023d5d-3a44-4b84-be62-2cd198cff4ff" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.541517] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1023d5d-3a44-4b84-be62-2cd198cff4ff" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.541517] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1023d5d-3a44-4b84-be62-2cd198cff4ff',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.741961] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.742344] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.742612] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.743719] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.744091] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.744362] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 48e98881-cbdc-4bbf-8b72-f5b3eaf5cc0b not found, creating... [ 657.744673] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.745427] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.745598] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.745852] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.745981] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.746513] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.746682] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.746791] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.747013] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.747146] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.747434] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 48e98881-cbdc-4bbf-8b72-f5b3eaf5cc0b is going to be created. [ 657.772808] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.773010] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.773120] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.773407] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.773625] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.776856] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-48e98881-cbdc-4bbf-8b72-f5b3eaf5cc0b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.950075] env[65783]: INFO networking_nsxv3.common.synchronization [None req-b4d1ab26-7eb7-40d2-8218-5a09c183ebb0 None None] Enqueued Resource ID: 6df62487-17d4-4014-a07f-29b9169646ab with Priority: HIGHEST for action port [ 657.950075] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6df62487-17d4-4014-a07f-29b9169646ab with Priority: HIGHEST for action port [ 657.950075] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-6df62487-17d4-4014-a07f-29b9169646ab taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.950075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6df62487-17d4-4014-a07f-29b9169646ab" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.950075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6df62487-17d4-4014-a07f-29b9169646ab" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.950075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6df62487-17d4-4014-a07f-29b9169646ab" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.950075] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6df62487-17d4-4014-a07f-29b9169646ab',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.047305] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1023d5d-3a44-4b84-be62-2cd198cff4ff [ 658.047305] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.047305] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.047531] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.048400] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.048479] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.048532] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1023d5d-3a44-4b84-be62-2cd198cff4ff already deleted. [ 658.050237] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1023d5d-3a44-4b84-be62-2cd198cff4ff" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.454078] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6df62487-17d4-4014-a07f-29b9169646ab [ 658.455023] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.455023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.455023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.455023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.455023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.457911] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6df62487-17d4-4014-a07f-29b9169646ab already deleted. [ 658.458141] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6df62487-17d4-4014-a07f-29b9169646ab" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.520121] env[65783]: INFO networking_nsxv3.common.synchronization [req-7f3ce582-838f-42ac-860d-61c8baa3957b req-89e08ae9-f848-4471-8250-2d4c261d202a service nova] Enqueued Resource ID: 12b54335-eb35-490d-a8d9-d12ac5809eb9 with Priority: HIGHEST for action security_group_rules [ 658.520121] env[65783]: INFO networking_nsxv3.common.synchronization [req-7f3ce582-838f-42ac-860d-61c8baa3957b req-89e08ae9-f848-4471-8250-2d4c261d202a service nova] Enqueued Resource ID: 12b54335-eb35-490d-a8d9-d12ac5809eb9 with Priority: HIGHEST for action security_group_members [ 658.520121] env[65783]: INFO networking_nsxv3.common.synchronization [req-7f3ce582-838f-42ac-860d-61c8baa3957b req-89e08ae9-f848-4471-8250-2d4c261d202a service nova] Enqueued Resource ID: 48e98881-cbdc-4bbf-8b72-f5b3eaf5cc0b with Priority: HIGHEST for action port [ 658.520710] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12b54335-eb35-490d-a8d9-d12ac5809eb9 with Priority: HIGHEST for action security_group_rules [ 658.520915] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12b54335-eb35-490d-a8d9-d12ac5809eb9 with Priority: HIGHEST for action security_group_members [ 658.521360] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48e98881-cbdc-4bbf-8b72-f5b3eaf5cc0b with Priority: HIGHEST for action port [ 658.521752] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12b54335-eb35-490d-a8d9-d12ac5809eb9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.521933] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.522162] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.522540] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.522540] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12b54335-eb35-490d-a8d9-d12ac5809eb9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.525237] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-12b54335-eb35-490d-a8d9-d12ac5809eb9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.525237] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.525237] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.525237] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.525500] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.525500] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.525500] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.525604] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.525704] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.525742] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12b54335-eb35-490d-a8d9-d12ac5809eb9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.527155] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-48e98881-cbdc-4bbf-8b72-f5b3eaf5cc0b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.527316] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48e98881-cbdc-4bbf-8b72-f5b3eaf5cc0b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.527316] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48e98881-cbdc-4bbf-8b72-f5b3eaf5cc0b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.528698] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48e98881-cbdc-4bbf-8b72-f5b3eaf5cc0b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.528698] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48e98881-cbdc-4bbf-8b72-f5b3eaf5cc0b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.691996] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 in Status: SUCCESS [ 658.692254] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.692425] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.692655] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.693114] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.693114] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.693114] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.693424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.693424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.693424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.693424] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.777111] env[65783]: INFO networking_nsxv3.common.synchronization [None req-69b096b7-1732-4cff-a708-18bae1b429b0 None None] Enqueued Resource ID: ee4f7816-e8a7-429b-b5ef-02e58eb05942 with Priority: HIGHEST for action port [ 658.778166] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee4f7816-e8a7-429b-b5ef-02e58eb05942 with Priority: HIGHEST for action port [ 658.778621] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee4f7816-e8a7-429b-b5ef-02e58eb05942 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.778824] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee4f7816-e8a7-429b-b5ef-02e58eb05942" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.778909] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee4f7816-e8a7-429b-b5ef-02e58eb05942" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.779270] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee4f7816-e8a7-429b-b5ef-02e58eb05942" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.779405] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee4f7816-e8a7-429b-b5ef-02e58eb05942',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.028339] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-12b54335-eb35-490d-a8d9-d12ac5809eb9 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.028339] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.028339] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12b54335-eb35-490d-a8d9-d12ac5809eb9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.032932] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48e98881-cbdc-4bbf-8b72-f5b3eaf5cc0b with status ACTIVE [ 659.032932] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.032932] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.032932] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.032932] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.032932] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.032932] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.032932] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.032932] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.032932] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.032932] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.033408] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.033408] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.033408] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.033714] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.034397] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.034397] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48e98881-cbdc-4bbf-8b72-f5b3eaf5cc0b is going to be updated. [ 659.059876] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.061987] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.062088] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.062260] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.062395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.062558] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48e98881-cbdc-4bbf-8b72-f5b3eaf5cc0b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.196288] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.196458] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.196817] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.196817] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.196990] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.196990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.197117] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.197198] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.197281] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.197281] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.197546] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.197770] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.197770] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.197770] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.198149] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.198149] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.198342] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.198342] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.198427] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.198472] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.198555] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.281870] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ee4f7816-e8a7-429b-b5ef-02e58eb05942 [ 659.282283] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.282283] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.282509] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.282562] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.282655] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.282749] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ee4f7816-e8a7-429b-b5ef-02e58eb05942 already deleted. [ 659.282831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee4f7816-e8a7-429b-b5ef-02e58eb05942" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.531226] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12b54335-eb35-490d-a8d9-d12ac5809eb9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.700775] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47: rpc.has_security_group_logging(os_id): False [ 659.721983] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.722122] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.722252] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.722525] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.722525] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.722735] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.722972] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.722972] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.723088] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.723141] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.723376] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.723502] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.723576] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.724481] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.724702] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.724844] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.724975] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.725076] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.726625] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.726705] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.726985] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 is going to be updated. [ 659.813164] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.813343] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.813391] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.813602] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.813759] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.831421] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 in Status: IN_PROGRESS for 2s [ 659.967095] env[65783]: INFO networking_nsxv3.common.synchronization [req-0be2118e-3197-47e8-83ca-839dea7088bd req-d4d6115d-c915-466d-9fb8-fc7a6e95a770 tempest-ServerDiskConfigTestJSON-664757069 tempest-ServerDiskConfigTestJSON-664757069-project-member] Enqueued Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 659.968158] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 659.968158] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.968158] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.968158] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.968397] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.968520] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.968603] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.968645] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.968819] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.968908] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.969016] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.035780] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.036036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.036036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.036232] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.036323] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.036419] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12b54335-eb35-490d-a8d9-d12ac5809eb9 is going to be created. [ 660.060744] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.060744] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.060892] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.061049] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.061258] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.077657] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12b54335-eb35-490d-a8d9-d12ac5809eb9 in Status: UNINITIALIZED for 2s [ 660.182614] env[65783]: INFO networking_nsxv3.common.synchronization [None req-8e631b65-310b-47f7-85b4-4d15364c7814 None None] Enqueued Resource ID: 6639f64f-da9d-4c5b-8be6-fb60c3519079 with Priority: HIGHEST for action port [ 660.186383] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6639f64f-da9d-4c5b-8be6-fb60c3519079 with Priority: HIGHEST for action port [ 660.187696] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-6639f64f-da9d-4c5b-8be6-fb60c3519079 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.188371] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6639f64f-da9d-4c5b-8be6-fb60c3519079" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.188483] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6639f64f-da9d-4c5b-8be6-fb60c3519079" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.189327] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6639f64f-da9d-4c5b-8be6-fb60c3519079" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.189327] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6639f64f-da9d-4c5b-8be6-fb60c3519079',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.224576] env[65783]: INFO networking_nsxv3.common.synchronization [None req-a19ee311-636b-48bd-874d-8093a2fe2bd2 None None] Enqueued Resource ID: 48168583-8b05-43b6-bb61-c6da26eaf49b with Priority: HIGHEST for action port [ 660.224854] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48168583-8b05-43b6-bb61-c6da26eaf49b with Priority: HIGHEST for action port [ 660.225396] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-48168583-8b05-43b6-bb61-c6da26eaf49b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.225838] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48168583-8b05-43b6-bb61-c6da26eaf49b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.225838] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48168583-8b05-43b6-bb61-c6da26eaf49b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.228028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48168583-8b05-43b6-bb61-c6da26eaf49b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.228028] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48168583-8b05-43b6-bb61-c6da26eaf49b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.230381] env[65783]: INFO networking_nsxv3.common.synchronization [req-049398b7-cbf7-4926-925f-a7dde4b8d7c7 req-dd610e60-b697-42d0-af4a-b62b87f67fbc tempest-ServerDiagnosticsNegativeTest-336669837 tempest-ServerDiagnosticsNegativeTest-336669837-project-member] Enqueued Resource ID: 5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 with Priority: HIGHEST for action security_group_members [ 660.230610] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 with Priority: HIGHEST for action security_group_members [ 660.231167] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.231329] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.231380] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.231554] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.231703] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.231795] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.231854] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.231994] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.232228] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.232373] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.408016] env[65783]: INFO networking_nsxv3.common.synchronization [req-2d3c1761-5ff5-4924-bb0d-8763076bf273 req-16ba2a84-e58f-4a3d-a080-d253a5631083 tempest-ImagesTestJSON-433702528 tempest-ImagesTestJSON-433702528-project-member] Enqueued Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 660.408589] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 660.408899] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.409856] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.409856] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.410183] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.410411] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.410927] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.411029] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.411226] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.411549] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.411674] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.473453] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.473587] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.473662] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.477161] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.477301] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.477613] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.477761] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.477832] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.478029] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.478247] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.478345] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 is going to be updated. [ 660.513575] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.513726] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.513792] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.514045] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.514182] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.525143] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: IN_PROGRESS for 2s [ 660.693403] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6639f64f-da9d-4c5b-8be6-fb60c3519079 [ 660.693665] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.693798] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.693862] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.694109] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.695027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.695027] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6639f64f-da9d-4c5b-8be6-fb60c3519079 already deleted. [ 660.695027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6639f64f-da9d-4c5b-8be6-fb60c3519079" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.728960] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48168583-8b05-43b6-bb61-c6da26eaf49b [ 660.729354] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.729539] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.729539] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.729757] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.729869] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.729968] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48168583-8b05-43b6-bb61-c6da26eaf49b already deleted. [ 660.730171] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48168583-8b05-43b6-bb61-c6da26eaf49b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.743622] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.743886] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.743886] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.744076] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.744076] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.744353] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.744519] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.744519] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.744814] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.744814] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.744814] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 is going to be updated. [ 660.777991] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.778144] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.778292] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.778405] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.778532] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.793266] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 in Status: IN_PROGRESS for 2s [ 660.915294] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.915294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.915294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.915294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.915294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.915294] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.915294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.915294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.915294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.915294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.915294] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd942bf-b305-4707-8084-1ac6b135c741 already deleted. [ 660.915294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.954365] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-509 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.954524] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-509" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.954669] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-509" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.954939] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-509" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.955210] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.955444] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.955556] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.955847] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.955847] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.956149] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 660.956308] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 660.956418] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 660.956522] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 660.956842] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 660.956842] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 660.956842] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 660.976267] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 660.976267] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 660.976267] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 660.976267] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-509" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.976267] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-290d5ac2-d3c4-4f0d-b549-523d4ef21f1b taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.976267] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-290d5ac2-d3c4-4f0d-b549-523d4ef21f1b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.976761] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-290d5ac2-d3c4-4f0d-b549-523d4ef21f1b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.976761] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-290d5ac2-d3c4-4f0d-b549-523d4ef21f1b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.976825] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('290d5ac2-d3c4-4f0d-b549-523d4ef21f1b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.365231] env[65783]: INFO networking_nsxv3.common.synchronization [None req-d40093b9-111e-40fa-b120-19143f09bc9d None None] Enqueued Resource ID: 5de9d91a-2143-46b5-b737-0e08d1e0a89e with Priority: HIGHEST for action port [ 661.368124] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5de9d91a-2143-46b5-b737-0e08d1e0a89e with Priority: HIGHEST for action port [ 661.368284] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-5de9d91a-2143-46b5-b737-0e08d1e0a89e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.368363] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5de9d91a-2143-46b5-b737-0e08d1e0a89e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.368418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5de9d91a-2143-46b5-b737-0e08d1e0a89e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.368739] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5de9d91a-2143-46b5-b737-0e08d1e0a89e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.369120] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5de9d91a-2143-46b5-b737-0e08d1e0a89e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.478798] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.479032] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.479158] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.479440] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.479580] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.479852] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 290d5ac2-d3c4-4f0d-b549-523d4ef21f1b not found, creating... [ 661.479982] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.480490] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.480490] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.480490] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.480642] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.481284] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.481284] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.481284] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.481450] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.481563] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.481690] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 290d5ac2-d3c4-4f0d-b549-523d4ef21f1b is going to be created. [ 661.502675] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.502873] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.502987] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.503639] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.504016] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.504151] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-290d5ac2-d3c4-4f0d-b549-523d4ef21f1b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.849106] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 in Status: SUCCESS [ 661.849528] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.873018] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5de9d91a-2143-46b5-b737-0e08d1e0a89e [ 661.875654] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.875654] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.875654] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.875654] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.875654] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.875654] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5de9d91a-2143-46b5-b737-0e08d1e0a89e already deleted. [ 661.875654] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5de9d91a-2143-46b5-b737-0e08d1e0a89e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.089032] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12b54335-eb35-490d-a8d9-d12ac5809eb9 in Status: SUCCESS [ 662.089032] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.089032] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.089326] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.089452] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.089609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.089686] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.089855] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.089938] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.090041] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.090190] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12b54335-eb35-490d-a8d9-d12ac5809eb9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.229931] env[65783]: INFO networking_nsxv3.common.synchronization [req-2d3c1761-5ff5-4924-bb0d-8763076bf273 req-759cd794-5367-4368-a1d2-0ac43b61ab91 service nova] Enqueued Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_rules [ 662.233161] env[65783]: INFO networking_nsxv3.common.synchronization [req-2d3c1761-5ff5-4924-bb0d-8763076bf273 req-759cd794-5367-4368-a1d2-0ac43b61ab91 service nova] Enqueued Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 662.233161] env[65783]: INFO networking_nsxv3.common.synchronization [req-2d3c1761-5ff5-4924-bb0d-8763076bf273 req-759cd794-5367-4368-a1d2-0ac43b61ab91 service nova] Enqueued Resource ID: 290d5ac2-d3c4-4f0d-b549-523d4ef21f1b with Priority: HIGHEST for action port [ 662.233161] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_rules [ 662.233161] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 662.233161] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 290d5ac2-d3c4-4f0d-b549-523d4ef21f1b with Priority: HIGHEST for action port [ 662.233161] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.233161] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.233161] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.233161] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.233161] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.233161] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.233769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.234557] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.234557] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.234557] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.235141] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.235141] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.235141] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.235141] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.235301] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.236299] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-290d5ac2-d3c4-4f0d-b549-523d4ef21f1b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.236656] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-290d5ac2-d3c4-4f0d-b549-523d4ef21f1b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.236656] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-290d5ac2-d3c4-4f0d-b549-523d4ef21f1b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.237547] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-290d5ac2-d3c4-4f0d-b549-523d4ef21f1b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.237645] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('290d5ac2-d3c4-4f0d-b549-523d4ef21f1b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.547338] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: SUCCESS [ 662.547338] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 deletion is rescheduled due to dependency. [ 662.547338] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.594860] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-12b54335-eb35-490d-a8d9-d12ac5809eb9 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.595059] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.595059] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.595310] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.595524] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.595671] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.595762] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.595963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.596083] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.596223] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.596436] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-12b54335-eb35-490d-a8d9-d12ac5809eb9 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.596747] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.597947] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.597947] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.597947] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.597947] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.597947] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.597947] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.597947] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.598323] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.598323] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12b54335-eb35-490d-a8d9-d12ac5809eb9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.741108] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.741108] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.741108] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.741635] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 290d5ac2-d3c4-4f0d-b549-523d4ef21f1b with status ACTIVE [ 662.741910] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.742097] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.742271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.742507] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.742640] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.745279] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.745417] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.745485] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.745703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.745790] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.746174] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.746174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.746293] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.746587] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.746587] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.746587] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 290d5ac2-d3c4-4f0d-b549-523d4ef21f1b is going to be updated. [ 662.777192] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.777351] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.777419] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.777634] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.777764] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.777923] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-290d5ac2-d3c4-4f0d-b549-523d4ef21f1b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.807136] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 in Status: SUCCESS [ 662.807542] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 deletion is rescheduled due to dependency. [ 662.807779] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.105267] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12b54335-eb35-490d-a8d9-d12ac5809eb9: rpc.has_security_group_logging(os_id): False [ 663.125856] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.125856] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.125856] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.125856] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.125856] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.125856] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.125856] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.125856] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.125856] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.125856] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.125856] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.125856] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.125856] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.125856] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.125856] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.126661] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.126661] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.126763] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.126867] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.126941] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.127059] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12b54335-eb35-490d-a8d9-d12ac5809eb9 is going to be created. [ 663.190390] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.190549] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.190607] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.190801] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.190970] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.204375] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12b54335-eb35-490d-a8d9-d12ac5809eb9 in Status: IN_PROGRESS for 2s [ 663.249146] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.518029] env[65783]: INFO networking_nsxv3.common.synchronization [None req-32dd92ed-b16d-4da2-ba60-b4f48d6836fc tempest-ServersTestJSON-1142340636 tempest-ServersTestJSON-1142340636-project-member] Enqueued Resource ID: 14427d59-3459-4ddd-9c42-78877a31172d with Priority: HIGHEST for action security_group_rules [ 663.518029] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14427d59-3459-4ddd-9c42-78877a31172d with Priority: HIGHEST for action security_group_rules [ 663.518029] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14427d59-3459-4ddd-9c42-78877a31172d taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.518029] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.518029] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.518029] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.518029] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14427d59-3459-4ddd-9c42-78877a31172d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.622885] env[65783]: INFO networking_nsxv3.common.synchronization [None req-507d1c5d-6441-475c-9513-e6c1b49f4fdc tempest-ServersTestBootFromVolume-1696516378 tempest-ServersTestBootFromVolume-1696516378-project-member] Enqueued Resource ID: 3654b92f-abc1-46ca-b6d3-5854c70c886e with Priority: HIGHEST for action security_group_rules [ 663.624260] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3654b92f-abc1-46ca-b6d3-5854c70c886e with Priority: HIGHEST for action security_group_rules [ 663.624260] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3654b92f-abc1-46ca-b6d3-5854c70c886e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.624260] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.624260] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.625588] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.625588] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3654b92f-abc1-46ca-b6d3-5854c70c886e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.671493] env[65783]: INFO networking_nsxv3.common.synchronization [None req-6e855d02-4f33-4df4-b54b-e074bb48c477 tempest-ServersTestJSON-1142340636 tempest-ServersTestJSON-1142340636-project-member] Enqueued Resource ID: 14427d59-3459-4ddd-9c42-78877a31172d with Priority: HIGHEST for action security_group_rules [ 663.671996] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14427d59-3459-4ddd-9c42-78877a31172d with Priority: HIGHEST for action security_group_rules [ 663.672361] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14427d59-3459-4ddd-9c42-78877a31172d taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.672434] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.731106] env[65783]: INFO networking_nsxv3.common.synchronization [None req-4395d08a-6026-4ae1-810c-4b32d84643a6 tempest-ServersV294TestFqdnHostnames-1151149332 tempest-ServersV294TestFqdnHostnames-1151149332-project-member] Enqueued Resource ID: 752cf951-e22b-4bfc-b89a-6766804d295f with Priority: HIGHEST for action security_group_rules [ 663.731715] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 752cf951-e22b-4bfc-b89a-6766804d295f with Priority: HIGHEST for action security_group_rules [ 663.732098] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-752cf951-e22b-4bfc-b89a-6766804d295f taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.732239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.732370] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.732711] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.732810] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('752cf951-e22b-4bfc-b89a-6766804d295f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.751778] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.752103] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.752216] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.752854] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.752981] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.753220] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd942bf-b305-4707-8084-1ac6b135c741 is going to be created. [ 663.793338] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.793512] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.793672] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.793874] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.794616] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.805662] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: UNINITIALIZED for 2s [ 663.864911] env[65783]: INFO networking_nsxv3.common.synchronization [None req-9f6d6bd2-c543-4b68-9930-c89c13fea238 tempest-ServersTestBootFromVolume-1696516378 tempest-ServersTestBootFromVolume-1696516378-project-member] Enqueued Resource ID: 3654b92f-abc1-46ca-b6d3-5854c70c886e with Priority: HIGHEST for action security_group_rules [ 663.865937] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3654b92f-abc1-46ca-b6d3-5854c70c886e with Priority: HIGHEST for action security_group_rules [ 663.866909] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3654b92f-abc1-46ca-b6d3-5854c70c886e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.867074] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.017909] env[65783]: INFO networking_nsxv3.common.synchronization [None req-9e79384e-56fe-4c44-bc03-527d82c3a796 tempest-ServersV294TestFqdnHostnames-1151149332 tempest-ServersV294TestFqdnHostnames-1151149332-project-member] Enqueued Resource ID: 752cf951-e22b-4bfc-b89a-6766804d295f with Priority: HIGHEST for action security_group_rules [ 664.018636] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 752cf951-e22b-4bfc-b89a-6766804d295f with Priority: HIGHEST for action security_group_rules [ 664.018914] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-752cf951-e22b-4bfc-b89a-6766804d295f taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.019035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.042367] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.042586] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.042673] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.043036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.043285] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.043376] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14427d59-3459-4ddd-9c42-78877a31172d already deleted. [ 664.043506] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.043739] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.044022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.044164] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14427d59-3459-4ddd-9c42-78877a31172d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.149613] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.151678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.151678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.151678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.151678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.151678] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3654b92f-abc1-46ca-b6d3-5854c70c886e already deleted. [ 664.151678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.151678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.151678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.151678] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3654b92f-abc1-46ca-b6d3-5854c70c886e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.253336] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.253542] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.253587] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.253803] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.253925] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.254040] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 752cf951-e22b-4bfc-b89a-6766804d295f already deleted. [ 664.254131] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.254289] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.254502] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.254590] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('752cf951-e22b-4bfc-b89a-6766804d295f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.566222] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.566222] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.566527] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.566603] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.566717] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.566837] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14427d59-3459-4ddd-9c42-78877a31172d already deleted. [ 664.566929] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.677161] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.677391] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.677475] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.678166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.678166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.678166] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3654b92f-abc1-46ca-b6d3-5854c70c886e already deleted. [ 664.678166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.779781] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.779951] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.780016] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.780480] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.780480] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.780480] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 752cf951-e22b-4bfc-b89a-6766804d295f already deleted. [ 664.780622] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.219864] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12b54335-eb35-490d-a8d9-d12ac5809eb9 in Status: SUCCESS [ 665.219864] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.818273] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: SUCCESS [ 665.818502] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.818800] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.819065] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.819112] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.819375] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.819375] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.819485] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.819529] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.820041] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.820041] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.185062] env[65783]: INFO networking_nsxv3.common.synchronization [req-dbc939cd-9429-4f93-9907-9efd3b7c5d8e req-bcc500cd-dcfe-43fe-b2dc-d731a4c830b6 tempest-FloatingIPsAssociationTestJSON-1491106384 tempest-FloatingIPsAssociationTestJSON-1491106384-project-member] Enqueued Resource ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e with Priority: HIGHEST for action security_group_members [ 666.185062] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e with Priority: HIGHEST for action security_group_members [ 666.185190] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.185259] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.185324] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.185583] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.185736] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.188747] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.188848] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.189065] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.189143] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.189293] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d536ed15-4c4c-44ea-b9bd-1b0e46123d7e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.325177] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.325539] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.325539] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.325639] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.327024] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.327024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.327024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.327024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.327024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.327024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.327024] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.327024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.327510] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.327510] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.327510] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.327510] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.327691] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.327740] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.327816] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.329334] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.329334] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.624058] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-307 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.624487] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-307" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.624487] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-307" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.624788] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-307" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.625112] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.625226] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.625331] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.625570] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.625695] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.625965] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.626245] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 666.626245] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 666.626398] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 666.626398] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.626505] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 666.626577] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 666.648927] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 666.649840] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 666.650661] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 666.650886] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-307" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.651237] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-89c8bddf-8224-4440-87da-352af62539fc taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.651468] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-89c8bddf-8224-4440-87da-352af62539fc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.651529] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-89c8bddf-8224-4440-87da-352af62539fc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.652094] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-89c8bddf-8224-4440-87da-352af62539fc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.652094] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89c8bddf-8224-4440-87da-352af62539fc',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.691862] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.692062] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.692134] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.692355] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.692449] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.692654] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.692916] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.693032] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.693216] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.693299] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.693409] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e already deleted. [ 666.693498] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.832126] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for efd942bf-b305-4707-8084-1ac6b135c741: rpc.has_security_group_logging(os_id): False [ 666.852136] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.852321] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.852389] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.852582] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.852673] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.852885] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.852987] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.853053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.853204] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.853270] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.853454] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.853545] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.853603] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.853741] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.853812] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.853982] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.854098] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.854171] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.854270] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.854343] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.854430] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efd942bf-b305-4707-8084-1ac6b135c741 is going to be created. [ 666.912203] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.912614] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.912614] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.912749] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.912879] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.924736] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: IN_PROGRESS for 2s [ 667.155346] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.155346] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.155346] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.155346] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.155538] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.155951] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 89c8bddf-8224-4440-87da-352af62539fc not found, creating... [ 667.155951] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.156091] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.156493] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.156493] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.156493] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.156749] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.157783] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.157783] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.157783] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.157783] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.157783] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 89c8bddf-8224-4440-87da-352af62539fc is going to be created. [ 667.178533] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.178863] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.179058] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.179395] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.179630] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.179932] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-89c8bddf-8224-4440-87da-352af62539fc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.961163] env[65783]: INFO networking_nsxv3.common.synchronization [req-dbc939cd-9429-4f93-9907-9efd3b7c5d8e req-18b4acbd-bdc3-4293-8675-5f777bab0d9d service nova] Enqueued Resource ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e with Priority: HIGHEST for action security_group_rules [ 667.961555] env[65783]: INFO networking_nsxv3.common.synchronization [req-dbc939cd-9429-4f93-9907-9efd3b7c5d8e req-18b4acbd-bdc3-4293-8675-5f777bab0d9d service nova] Enqueued Resource ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e with Priority: HIGHEST for action security_group_members [ 667.961555] env[65783]: INFO networking_nsxv3.common.synchronization [req-dbc939cd-9429-4f93-9907-9efd3b7c5d8e req-18b4acbd-bdc3-4293-8675-5f777bab0d9d service nova] Enqueued Resource ID: 89c8bddf-8224-4440-87da-352af62539fc with Priority: HIGHEST for action port [ 667.964026] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e with Priority: HIGHEST for action security_group_rules [ 667.964026] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e with Priority: HIGHEST for action security_group_members [ 667.964026] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89c8bddf-8224-4440-87da-352af62539fc with Priority: HIGHEST for action port [ 667.964303] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.964303] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.964303] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.964612] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.964694] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d536ed15-4c4c-44ea-b9bd-1b0e46123d7e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.965812] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.965812] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.965976] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.966048] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.966209] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.966319] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.966389] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.966561] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.966643] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.966741] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d536ed15-4c4c-44ea-b9bd-1b0e46123d7e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.970602] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-89c8bddf-8224-4440-87da-352af62539fc taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.970602] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89c8bddf-8224-4440-87da-352af62539fc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.970602] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89c8bddf-8224-4440-87da-352af62539fc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.970602] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89c8bddf-8224-4440-87da-352af62539fc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.970602] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89c8bddf-8224-4440-87da-352af62539fc',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.471688] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.471835] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.472156] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d536ed15-4c4c-44ea-b9bd-1b0e46123d7e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.472901] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89c8bddf-8224-4440-87da-352af62539fc with status ACTIVE [ 668.473096] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.473220] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.473283] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.473490] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.473608] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.473754] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.473851] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.473909] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.474339] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.474339] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.474339] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.474561] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.474561] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.474658] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.474658] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.474760] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89c8bddf-8224-4440-87da-352af62539fc is going to be updated. [ 668.500957] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.501186] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.501309] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.501495] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.501640] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.501796] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89c8bddf-8224-4440-87da-352af62539fc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.940110] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: SUCCESS [ 668.940401] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.979456] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d536ed15-4c4c-44ea-b9bd-1b0e46123d7e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.480652] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.480855] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.482044] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.482044] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.482044] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.482044] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e is going to be created. [ 669.511717] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.511865] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.511941] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.512222] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.512401] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.524997] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e in Status: UNINITIALIZED for 2s [ 671.539409] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e in Status: SUCCESS [ 671.539409] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.539409] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.539915] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.539915] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.540075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.540075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.541068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.541176] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.541765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.541765] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d536ed15-4c4c-44ea-b9bd-1b0e46123d7e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.691747] env[65783]: INFO networking_nsxv3.common.synchronization [req-f7005cfd-b92d-4cbc-a851-e4333d7394ca req-a1cc7b63-9f88-4ab3-8ce7-c60bb7d76f4c tempest-ServerGroupTestJSON-559816597 tempest-ServerGroupTestJSON-559816597-project-member] Enqueued Resource ID: 29c3066f-92d6-4fd9-a20b-96651c82bc4b with Priority: HIGHEST for action security_group_members [ 671.692412] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29c3066f-92d6-4fd9-a20b-96651c82bc4b with Priority: HIGHEST for action security_group_members [ 671.692987] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-29c3066f-92d6-4fd9-a20b-96651c82bc4b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.692987] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.693241] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.693366] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.693548] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.693673] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.693673] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.693811] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.693881] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.693967] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29c3066f-92d6-4fd9-a20b-96651c82bc4b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.045380] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.045380] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.045380] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.045380] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.045722] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.045722] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.045722] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.045846] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.045846] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.045907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.046075] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.046169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.046227] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.046352] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.046489] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.046580] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.046677] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.046801] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.046871] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.046947] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.047052] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d536ed15-4c4c-44ea-b9bd-1b0e46123d7e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.118937] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-423 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.119579] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-423" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.119792] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-423" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.120247] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-423" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.120662] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.120910] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.121110] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.121422] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.121607] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.121866] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 672.122063] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 672.122248] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 672.122460] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 672.122607] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 672.122746] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 672.122954] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 672.146913] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 672.147093] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 672.147239] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 672.147452] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-423" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.147739] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-25e52706-fea9-4ef1-8374-25b6f71a10d4 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.147930] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-25e52706-fea9-4ef1-8374-25b6f71a10d4" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.148187] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-25e52706-fea9-4ef1-8374-25b6f71a10d4" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.148448] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-25e52706-fea9-4ef1-8374-25b6f71a10d4" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.148620] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25e52706-fea9-4ef1-8374-25b6f71a10d4',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.197798] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.198061] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.198174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.198474] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.198606] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.198835] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.198947] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.199013] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.199187] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.199276] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.199367] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29c3066f-92d6-4fd9-a20b-96651c82bc4b already deleted. [ 672.199447] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.549784] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d536ed15-4c4c-44ea-b9bd-1b0e46123d7e: rpc.has_security_group_logging(os_id): False [ 672.571719] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.571837] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.571918] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.572223] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.572374] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.572604] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.572711] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.572865] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.573362] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.573362] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.573362] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.573656] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.573656] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.573656] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.573855] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.573957] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.574286] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.574376] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.574661] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.574968] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.574968] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e is going to be created. [ 672.652134] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.652134] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.652801] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.653285] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.653285] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.653384] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 25e52706-fea9-4ef1-8374-25b6f71a10d4 not found, creating... [ 672.653903] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.654033] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.654386] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.655033] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.655033] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.655421] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.656339] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.656339] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.656624] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.657706] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.657706] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 25e52706-fea9-4ef1-8374-25b6f71a10d4 is going to be created. [ 672.694961] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.694961] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.694961] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.694961] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.694961] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.694961] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-25e52706-fea9-4ef1-8374-25b6f71a10d4" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.719450] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.719646] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.719756] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.720071] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.720475] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.756773] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e in Status: IN_PROGRESS for 2s [ 673.457916] env[65783]: INFO networking_nsxv3.common.synchronization [req-f7005cfd-b92d-4cbc-a851-e4333d7394ca req-9c443e01-622b-4467-888c-22235e334143 service nova] Enqueued Resource ID: 29c3066f-92d6-4fd9-a20b-96651c82bc4b with Priority: HIGHEST for action security_group_rules [ 673.460785] env[65783]: INFO networking_nsxv3.common.synchronization [req-f7005cfd-b92d-4cbc-a851-e4333d7394ca req-9c443e01-622b-4467-888c-22235e334143 service nova] Enqueued Resource ID: 29c3066f-92d6-4fd9-a20b-96651c82bc4b with Priority: HIGHEST for action security_group_members [ 673.460785] env[65783]: INFO networking_nsxv3.common.synchronization [req-f7005cfd-b92d-4cbc-a851-e4333d7394ca req-9c443e01-622b-4467-888c-22235e334143 service nova] Enqueued Resource ID: 25e52706-fea9-4ef1-8374-25b6f71a10d4 with Priority: HIGHEST for action port [ 673.461701] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29c3066f-92d6-4fd9-a20b-96651c82bc4b with Priority: HIGHEST for action security_group_rules [ 673.461999] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29c3066f-92d6-4fd9-a20b-96651c82bc4b with Priority: HIGHEST for action security_group_members [ 673.462107] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25e52706-fea9-4ef1-8374-25b6f71a10d4 with Priority: HIGHEST for action port [ 673.462511] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29c3066f-92d6-4fd9-a20b-96651c82bc4b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.462750] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.462896] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.463306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.463456] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29c3066f-92d6-4fd9-a20b-96651c82bc4b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.464786] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-29c3066f-92d6-4fd9-a20b-96651c82bc4b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.465490] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.465490] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.465490] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.465701] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.467099] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.467099] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.467099] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.467099] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.467099] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29c3066f-92d6-4fd9-a20b-96651c82bc4b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.467940] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-25e52706-fea9-4ef1-8374-25b6f71a10d4 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.468065] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25e52706-fea9-4ef1-8374-25b6f71a10d4" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.468165] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25e52706-fea9-4ef1-8374-25b6f71a10d4" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.468323] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25e52706-fea9-4ef1-8374-25b6f71a10d4" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.468421] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25e52706-fea9-4ef1-8374-25b6f71a10d4',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.970029] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-29c3066f-92d6-4fd9-a20b-96651c82bc4b taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.970676] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.972581] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 25e52706-fea9-4ef1-8374-25b6f71a10d4 with status ACTIVE [ 673.972941] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.973456] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.973625] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.974008] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.974608] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.974608] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.974608] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.974803] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.974951] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.975096] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.975411] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.975616] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.975695] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.975883] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.976038] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.976273] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 25e52706-fea9-4ef1-8374-25b6f71a10d4 is going to be updated. [ 673.978072] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('29c3066f-92d6-4fd9-a20b-96651c82bc4b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.009317] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.009500] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.009559] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.009773] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.009951] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.010136] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25e52706-fea9-4ef1-8374-25b6f71a10d4" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.482094] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('29c3066f-92d6-4fd9-a20b-96651c82bc4b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.770157] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e in Status: SUCCESS [ 674.770157] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.985859] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.986237] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.986237] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.986395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.986516] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.986617] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29c3066f-92d6-4fd9-a20b-96651c82bc4b is going to be created. [ 675.020701] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.020851] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.020851] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.021048] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.021208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.034630] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29c3066f-92d6-4fd9-a20b-96651c82bc4b in Status: UNINITIALIZED for 2s [ 676.662210] env[65783]: INFO networking_nsxv3.common.synchronization [req-433d4a32-a981-439c-a4c6-f54dc61e397f req-fd67812a-0921-4748-9fa9-04136e399db1 tempest-ServersNegativeTestMultiTenantJSON-993199092 tempest-ServersNegativeTestMultiTenantJSON-993199092-project-member] Enqueued Resource ID: e285eaec-686f-4ae5-a9aa-59215e24189f with Priority: HIGHEST for action security_group_members [ 676.662210] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e285eaec-686f-4ae5-a9aa-59215e24189f with Priority: HIGHEST for action security_group_members [ 676.663500] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e285eaec-686f-4ae5-a9aa-59215e24189f taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.663875] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.664072] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.664453] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.664761] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.665290] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.665617] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.666763] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.666763] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.666763] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e285eaec-686f-4ae5-a9aa-59215e24189f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.049388] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29c3066f-92d6-4fd9-a20b-96651c82bc4b in Status: SUCCESS [ 677.049388] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.049388] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.049388] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.049780] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.049780] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.049780] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.049929] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.049966] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.050546] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.050546] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('29c3066f-92d6-4fd9-a20b-96651c82bc4b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.169042] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.169359] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.169457] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.169767] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.169917] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.170378] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.170525] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.170525] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.170694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.170762] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.170854] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e285eaec-686f-4ae5-a9aa-59215e24189f already deleted. [ 677.171036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.464167] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-783 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.464392] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-783" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.464513] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-783" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.464855] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-783" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.465132] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.465287] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.465398] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.465606] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.465740] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.465943] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 677.466072] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 677.466178] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 677.466281] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 677.466386] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 677.466507] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 677.466691] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 677.489024] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 677.489221] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 677.489373] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 677.489608] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-783" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.489967] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-041beec2-3c7a-44fa-9df0-2681c50094b9 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.490181] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-041beec2-3c7a-44fa-9df0-2681c50094b9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.490441] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-041beec2-3c7a-44fa-9df0-2681c50094b9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.490843] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-041beec2-3c7a-44fa-9df0-2681c50094b9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.490991] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('041beec2-3c7a-44fa-9df0-2681c50094b9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.553879] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-29c3066f-92d6-4fd9-a20b-96651c82bc4b taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.553879] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.553879] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.553879] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.554295] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.554295] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.554445] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.554529] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.554665] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.554746] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.554938] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-29c3066f-92d6-4fd9-a20b-96651c82bc4b taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.555120] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.555192] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.555828] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.555828] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.555828] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.555828] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.556170] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.556170] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.556170] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.556265] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('29c3066f-92d6-4fd9-a20b-96651c82bc4b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.993898] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.994216] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.994268] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.994534] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.994732] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.994911] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 041beec2-3c7a-44fa-9df0-2681c50094b9 not found, creating... [ 677.995244] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.995441] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.995586] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.995891] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.995980] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.996357] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.997510] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.997510] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.997510] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.997510] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.997510] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 041beec2-3c7a-44fa-9df0-2681c50094b9 is going to be created. [ 678.023798] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.024099] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.024478] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.024842] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.025147] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.025552] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-041beec2-3c7a-44fa-9df0-2681c50094b9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.058431] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 29c3066f-92d6-4fd9-a20b-96651c82bc4b: rpc.has_security_group_logging(os_id): False [ 678.078925] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.079173] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.079173] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.079377] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.079471] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.079683] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.079984] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.079984] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.079984] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.080165] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.080249] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.080532] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.080532] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.080650] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.080753] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.080893] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.081079] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.081582] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.081762] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.081846] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.081957] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29c3066f-92d6-4fd9-a20b-96651c82bc4b is going to be created. [ 678.201924] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.202212] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.202376] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.202511] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.203063] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.219184] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29c3066f-92d6-4fd9-a20b-96651c82bc4b in Status: IN_PROGRESS for 2s [ 678.728840] env[65783]: INFO networking_nsxv3.common.synchronization [req-433d4a32-a981-439c-a4c6-f54dc61e397f req-7a0fb089-e628-45f5-bab3-33fc9e84efa5 service nova] Enqueued Resource ID: e285eaec-686f-4ae5-a9aa-59215e24189f with Priority: HIGHEST for action security_group_rules [ 678.729316] env[65783]: INFO networking_nsxv3.common.synchronization [req-433d4a32-a981-439c-a4c6-f54dc61e397f req-7a0fb089-e628-45f5-bab3-33fc9e84efa5 service nova] Enqueued Resource ID: e285eaec-686f-4ae5-a9aa-59215e24189f with Priority: HIGHEST for action security_group_members [ 678.729316] env[65783]: INFO networking_nsxv3.common.synchronization [req-433d4a32-a981-439c-a4c6-f54dc61e397f req-7a0fb089-e628-45f5-bab3-33fc9e84efa5 service nova] Enqueued Resource ID: 041beec2-3c7a-44fa-9df0-2681c50094b9 with Priority: HIGHEST for action port [ 678.729773] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e285eaec-686f-4ae5-a9aa-59215e24189f with Priority: HIGHEST for action security_group_rules [ 678.729938] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e285eaec-686f-4ae5-a9aa-59215e24189f with Priority: HIGHEST for action security_group_members [ 678.729981] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 041beec2-3c7a-44fa-9df0-2681c50094b9 with Priority: HIGHEST for action port [ 678.730236] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e285eaec-686f-4ae5-a9aa-59215e24189f taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.730387] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.730501] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.731814] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.731916] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e285eaec-686f-4ae5-a9aa-59215e24189f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.734008] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e285eaec-686f-4ae5-a9aa-59215e24189f taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.735160] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.735236] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.736728] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.738853] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.738853] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.738853] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.738853] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.738853] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.738853] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e285eaec-686f-4ae5-a9aa-59215e24189f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.741108] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-041beec2-3c7a-44fa-9df0-2681c50094b9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.741108] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-041beec2-3c7a-44fa-9df0-2681c50094b9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.741108] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-041beec2-3c7a-44fa-9df0-2681c50094b9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.741108] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-041beec2-3c7a-44fa-9df0-2681c50094b9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.741108] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('041beec2-3c7a-44fa-9df0-2681c50094b9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.204082] env[65783]: INFO networking_nsxv3.common.synchronization [req-b7b58700-7726-4c54-8a03-794b625022f9 req-a2e75afe-7e7b-4522-9e42-0448520744d1 tempest-ServerMetadataNegativeTestJSON-249816056 tempest-ServerMetadataNegativeTestJSON-249816056-project-member] Enqueued Resource ID: faef4af0-512c-4f90-a00c-065908fadd11 with Priority: HIGHEST for action security_group_members [ 679.204658] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faef4af0-512c-4f90-a00c-065908fadd11 with Priority: HIGHEST for action security_group_members [ 679.204947] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-faef4af0-512c-4f90-a00c-065908fadd11 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.205083] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.205151] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.205357] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.205514] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.205615] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.205667] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.205815] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.205894] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.205987] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('faef4af0-512c-4f90-a00c-065908fadd11',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.242365] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e285eaec-686f-4ae5-a9aa-59215e24189f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.243693] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 041beec2-3c7a-44fa-9df0-2681c50094b9 with status ACTIVE [ 679.244938] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.244938] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.244938] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.244938] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.245216] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.245216] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.245299] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.245353] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.245531] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.245586] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.245764] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.245866] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.245928] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.246077] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.246147] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.246228] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 041beec2-3c7a-44fa-9df0-2681c50094b9 is going to be updated. [ 679.248808] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e285eaec-686f-4ae5-a9aa-59215e24189f taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.248928] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.276477] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.276477] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.276477] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.276477] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.277084] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.277084] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-041beec2-3c7a-44fa-9df0-2681c50094b9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.496803] env[65783]: INFO networking_nsxv3.common.synchronization [req-609cce84-2a66-4689-9206-819fb06ae0aa req-0e41d709-1545-4d82-a07a-c74c139f53aa tempest-DeleteServersAdminTestJSON-1691143419 tempest-DeleteServersAdminTestJSON-1691143419-project-member] Enqueued Resource ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 with Priority: HIGHEST for action security_group_members [ 679.497465] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 with Priority: HIGHEST for action security_group_members [ 679.497846] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.497967] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.498025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.498351] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.498431] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.498489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.498556] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.498702] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.498784] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.498876] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.612903] env[65783]: INFO networking_nsxv3.common.synchronization [None req-118614c1-6709-4650-bf7e-cd93d81222f3 None None] Enqueued Resource ID: 0256a29b-da13-41e2-b543-fbfee40bd493 with Priority: HIGHEST for action port [ 679.614898] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0256a29b-da13-41e2-b543-fbfee40bd493 with Priority: HIGHEST for action port [ 679.614898] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-0256a29b-da13-41e2-b543-fbfee40bd493 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.614898] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0256a29b-da13-41e2-b543-fbfee40bd493" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.614898] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0256a29b-da13-41e2-b543-fbfee40bd493" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.614898] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0256a29b-da13-41e2-b543-fbfee40bd493" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.614898] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0256a29b-da13-41e2-b543-fbfee40bd493',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.708367] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.708595] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.708694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.708998] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.709152] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.709427] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.709597] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.709704] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.709945] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.710092] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.710244] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: faef4af0-512c-4f90-a00c-065908fadd11 is going to be updated. [ 679.744551] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e285eaec-686f-4ae5-a9aa-59215e24189f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.746632] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.746763] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.746833] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.747206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.747206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.758567] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: faef4af0-512c-4f90-a00c-065908fadd11 in Status: IN_PROGRESS for 2s [ 680.001592] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.001828] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.001828] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.002087] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.002183] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.002481] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.002481] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.002624] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.002699] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.002774] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.002874] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 is going to be updated. [ 680.033880] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.034196] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.034238] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.034432] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.034563] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.048715] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 in Status: IN_PROGRESS for 2s [ 680.118351] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0256a29b-da13-41e2-b543-fbfee40bd493 [ 680.118351] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.118351] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.118351] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.118351] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.118723] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.118723] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0256a29b-da13-41e2-b543-fbfee40bd493 already deleted. [ 680.118723] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0256a29b-da13-41e2-b543-fbfee40bd493" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.233734] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29c3066f-92d6-4fd9-a20b-96651c82bc4b in Status: SUCCESS [ 680.233734] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.251031] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.251031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.251031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.251031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.251031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.251031] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e285eaec-686f-4ae5-a9aa-59215e24189f is going to be created. [ 680.291440] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.291647] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.291722] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.291951] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.293231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.311583] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e285eaec-686f-4ae5-a9aa-59215e24189f in Status: UNINITIALIZED for 2s [ 680.482136] env[65783]: INFO networking_nsxv3.common.synchronization [None req-004a0282-0324-4e6f-97db-bc4d52806483 None None] Enqueued Resource ID: 2a001149-b772-481a-b9a2-0e302e56dd71 with Priority: HIGHEST for action port [ 680.482249] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a001149-b772-481a-b9a2-0e302e56dd71 with Priority: HIGHEST for action port [ 680.482932] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a001149-b772-481a-b9a2-0e302e56dd71 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.483322] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a001149-b772-481a-b9a2-0e302e56dd71" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.483721] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a001149-b772-481a-b9a2-0e302e56dd71" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.484013] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a001149-b772-481a-b9a2-0e302e56dd71" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.484119] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a001149-b772-481a-b9a2-0e302e56dd71',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.987410] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2a001149-b772-481a-b9a2-0e302e56dd71 [ 680.987667] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.987806] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.987876] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.988106] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.988374] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.988532] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2a001149-b772-481a-b9a2-0e302e56dd71 already deleted. [ 680.988664] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a001149-b772-481a-b9a2-0e302e56dd71" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.582696] env[65783]: INFO networking_nsxv3.common.synchronization [None req-7a2ae296-b499-40c7-875a-47083b629453 None None] Enqueued Resource ID: dbe8d587-e952-421e-8662-478736b1a7dc with Priority: HIGHEST for action port [ 681.582696] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe8d587-e952-421e-8662-478736b1a7dc with Priority: HIGHEST for action port [ 681.582696] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbe8d587-e952-421e-8662-478736b1a7dc taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.582696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbe8d587-e952-421e-8662-478736b1a7dc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.582696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbe8d587-e952-421e-8662-478736b1a7dc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.583408] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbe8d587-e952-421e-8662-478736b1a7dc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.583408] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbe8d587-e952-421e-8662-478736b1a7dc',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.772492] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: faef4af0-512c-4f90-a00c-065908fadd11 in Status: SUCCESS [ 681.772858] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: faef4af0-512c-4f90-a00c-065908fadd11 deletion is rescheduled due to dependency. [ 681.772858] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.071393] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 in Status: SUCCESS [ 682.071787] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 deletion is rescheduled due to dependency. [ 682.072364] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.087848] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dbe8d587-e952-421e-8662-478736b1a7dc [ 682.089362] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.090054] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.090054] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.090252] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.090459] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.090570] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dbe8d587-e952-421e-8662-478736b1a7dc already deleted. [ 682.090662] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbe8d587-e952-421e-8662-478736b1a7dc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.325273] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e285eaec-686f-4ae5-a9aa-59215e24189f in Status: SUCCESS [ 682.325509] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.325721] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.325949] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.326168] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.326305] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.326353] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.326499] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.326572] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.326657] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.326747] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e285eaec-686f-4ae5-a9aa-59215e24189f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.831830] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e285eaec-686f-4ae5-a9aa-59215e24189f taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.831830] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.831830] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.831830] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.831830] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.832363] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.832363] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.832363] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.832363] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.832465] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.832684] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e285eaec-686f-4ae5-a9aa-59215e24189f taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.832792] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.833174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.833174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.833256] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.833403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.833439] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.833770] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.833770] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.833831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.834453] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e285eaec-686f-4ae5-a9aa-59215e24189f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.337842] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e285eaec-686f-4ae5-a9aa-59215e24189f: rpc.has_security_group_logging(os_id): False [ 683.343197] env[65783]: INFO networking_nsxv3.common.synchronization [req-a981dee0-c19b-4fd8-ae35-ff5296724514 req-613cd822-001e-4e82-aa2c-efd19578f6c4 tempest-VolumesAdminNegativeTest-1754688451 tempest-VolumesAdminNegativeTest-1754688451-project-member] Enqueued Resource ID: 12b54335-eb35-490d-a8d9-d12ac5809eb9 with Priority: HIGHEST for action security_group_members [ 683.343380] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12b54335-eb35-490d-a8d9-d12ac5809eb9 with Priority: HIGHEST for action security_group_members [ 683.343681] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-12b54335-eb35-490d-a8d9-d12ac5809eb9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.343801] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.343865] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.344138] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.344296] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.344584] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.344584] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.344684] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.344961] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.344961] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12b54335-eb35-490d-a8d9-d12ac5809eb9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.357779] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.357956] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.358026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.358222] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.358299] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.358535] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.358638] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.358696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.358845] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.358944] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.359165] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.359280] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.359346] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.359479] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.359557] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.359733] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.359823] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.359882] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.361397] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.361623] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.365113] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e285eaec-686f-4ae5-a9aa-59215e24189f is going to be created. [ 683.428579] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.429293] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.429369] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.429656] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.429875] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.443510] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e285eaec-686f-4ae5-a9aa-59215e24189f in Status: IN_PROGRESS for 2s [ 683.536285] env[65783]: INFO networking_nsxv3.common.synchronization [None req-fc2d8116-9a10-4d84-87e5-7a2a648a1020 None None] Enqueued Resource ID: f4d909cf-b78f-4560-aaf1-d84e9fe0180e with Priority: HIGHEST for action port [ 683.536966] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4d909cf-b78f-4560-aaf1-d84e9fe0180e with Priority: HIGHEST for action port [ 683.538660] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4d909cf-b78f-4560-aaf1-d84e9fe0180e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.538729] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4d909cf-b78f-4560-aaf1-d84e9fe0180e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.538791] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4d909cf-b78f-4560-aaf1-d84e9fe0180e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.539706] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4d909cf-b78f-4560-aaf1-d84e9fe0180e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.539804] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4d909cf-b78f-4560-aaf1-d84e9fe0180e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.847884] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.848333] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.848333] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.848689] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.849081] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.850150] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.850776] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.850776] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.851117] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.851242] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.851368] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12b54335-eb35-490d-a8d9-d12ac5809eb9 is going to be updated. [ 683.889760] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.889760] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.889760] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.889760] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.889760] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.898836] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12b54335-eb35-490d-a8d9-d12ac5809eb9 in Status: IN_PROGRESS for 2s [ 684.044362] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f4d909cf-b78f-4560-aaf1-d84e9fe0180e [ 684.044528] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.044689] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.044740] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.044998] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.045105] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.045212] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f4d909cf-b78f-4560-aaf1-d84e9fe0180e already deleted. [ 684.045297] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4d909cf-b78f-4560-aaf1-d84e9fe0180e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.834851] env[65783]: INFO networking_nsxv3.common.synchronization [req-dfcf5f31-4ac4-4514-baea-f4ee675628ae req-c0dc96e8-3008-4eff-ac85-106d77028856 tempest-SecurityGroupRulesTestJSON-1774018064 tempest-SecurityGroupRulesTestJSON-1774018064-project-member] Enqueued Resource ID: db8c666b-66e7-452f-9fc5-7d0fc66ac2f5 with Priority: HIGHEST for action security_group_rules [ 684.835418] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db8c666b-66e7-452f-9fc5-7d0fc66ac2f5 with Priority: HIGHEST for action security_group_rules [ 684.835713] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db8c666b-66e7-452f-9fc5-7d0fc66ac2f5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.835836] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db8c666b-66e7-452f-9fc5-7d0fc66ac2f5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.835902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db8c666b-66e7-452f-9fc5-7d0fc66ac2f5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.836243] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db8c666b-66e7-452f-9fc5-7d0fc66ac2f5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.836360] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db8c666b-66e7-452f-9fc5-7d0fc66ac2f5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.356823] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.357129] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.357129] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.357275] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.357354] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.357445] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db8c666b-66e7-452f-9fc5-7d0fc66ac2f5 already deleted. [ 685.357507] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db8c666b-66e7-452f-9fc5-7d0fc66ac2f5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.455535] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e285eaec-686f-4ae5-a9aa-59215e24189f in Status: SUCCESS [ 685.455823] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.910684] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12b54335-eb35-490d-a8d9-d12ac5809eb9 in Status: SUCCESS [ 685.910851] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12b54335-eb35-490d-a8d9-d12ac5809eb9 deletion is rescheduled due to dependency. [ 685.910983] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.114153] env[65783]: INFO networking_nsxv3.common.synchronization [req-60560c6c-398b-4ddb-a4b5-28e588aca20b req-344e5c0f-dae2-4367-9c0a-873dd9cd50d8 tempest-ServerDiskConfigTestJSON-664757069 tempest-ServerDiskConfigTestJSON-664757069-project-member] Enqueued Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 687.114704] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 687.115010] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.115594] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.115678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.115856] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.116019] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.116120] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.116181] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.116339] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.116436] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.116530] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.607867] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-965 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.608113] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-965" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.608238] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-965" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.608431] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-965" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.608695] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.608968] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.608968] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.612946] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.612946] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.612946] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 687.612946] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 687.612946] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 687.612946] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 687.612946] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 687.612946] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 687.612946] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 687.620609] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.620609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.620609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.620609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.620609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.620609] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.620609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.620609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.620609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.620609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.620609] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 is going to be updated. [ 687.636854] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 687.636854] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 687.637090] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 687.637294] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-965" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.637754] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-42a7074e-6547-4c88-96e5-693f66c36882 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.637998] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-42a7074e-6547-4c88-96e5-693f66c36882" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.638191] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-42a7074e-6547-4c88-96e5-693f66c36882" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.638665] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-42a7074e-6547-4c88-96e5-693f66c36882" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.638846] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42a7074e-6547-4c88-96e5-693f66c36882',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.661748] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.661892] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.662023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.662341] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.662619] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.674180] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: IN_PROGRESS for 2s [ 687.963862] env[65783]: INFO networking_nsxv3.common.synchronization [None req-ade1384e-b65d-481b-b91c-9520f40e7900 None None] Enqueued Resource ID: ad82e72f-96f7-4c10-ae00-9d3f3d31efb3 with Priority: HIGHEST for action port [ 687.964658] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad82e72f-96f7-4c10-ae00-9d3f3d31efb3 with Priority: HIGHEST for action port [ 687.965190] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad82e72f-96f7-4c10-ae00-9d3f3d31efb3 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.965443] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad82e72f-96f7-4c10-ae00-9d3f3d31efb3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.965542] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad82e72f-96f7-4c10-ae00-9d3f3d31efb3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.965885] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad82e72f-96f7-4c10-ae00-9d3f3d31efb3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.966584] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad82e72f-96f7-4c10-ae00-9d3f3d31efb3',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.142855] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.143304] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.143304] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.143526] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.143675] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.144160] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 42a7074e-6547-4c88-96e5-693f66c36882 not found, creating... [ 688.144160] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.144322] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.144375] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.144615] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.144981] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.145054] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.145247] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.145398] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.145602] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.145761] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.146218] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 42a7074e-6547-4c88-96e5-693f66c36882 is going to be created. [ 688.173134] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.173374] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.173469] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.173756] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.173973] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.174204] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-42a7074e-6547-4c88-96e5-693f66c36882" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.470867] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad82e72f-96f7-4c10-ae00-9d3f3d31efb3 [ 688.471076] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.471228] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.471301] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.471750] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.471848] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.471951] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad82e72f-96f7-4c10-ae00-9d3f3d31efb3 already deleted. [ 688.472048] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad82e72f-96f7-4c10-ae00-9d3f3d31efb3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.926027] env[65783]: INFO networking_nsxv3.common.synchronization [req-60560c6c-398b-4ddb-a4b5-28e588aca20b req-d49be57d-15b9-4927-a65b-a08fab242ef4 service nova] Enqueued Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_rules [ 688.926027] env[65783]: INFO networking_nsxv3.common.synchronization [req-60560c6c-398b-4ddb-a4b5-28e588aca20b req-d49be57d-15b9-4927-a65b-a08fab242ef4 service nova] Enqueued Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 688.926027] env[65783]: INFO networking_nsxv3.common.synchronization [req-60560c6c-398b-4ddb-a4b5-28e588aca20b req-d49be57d-15b9-4927-a65b-a08fab242ef4 service nova] Enqueued Resource ID: 42a7074e-6547-4c88-96e5-693f66c36882 with Priority: HIGHEST for action port [ 688.926027] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_rules [ 688.926027] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 688.926027] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a7074e-6547-4c88-96e5-693f66c36882 with Priority: HIGHEST for action port [ 688.927219] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.930357] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.930357] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.930357] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.930357] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.930357] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.930357] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.930357] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-42a7074e-6547-4c88-96e5-693f66c36882 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.930357] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42a7074e-6547-4c88-96e5-693f66c36882" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.930357] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42a7074e-6547-4c88-96e5-693f66c36882" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.930357] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42a7074e-6547-4c88-96e5-693f66c36882" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.930357] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42a7074e-6547-4c88-96e5-693f66c36882',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.016131] env[65783]: INFO networking_nsxv3.common.synchronization [None req-5f07d93e-5cce-4850-a186-335f229810e7 tempest-MigrationsAdminTest-1412758904 tempest-MigrationsAdminTest-1412758904-project-member] Enqueued Resource ID: 172bf292-f948-416d-8b6b-b5776cb9e283 with Priority: HIGHEST for action security_group_rules [ 689.016131] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 172bf292-f948-416d-8b6b-b5776cb9e283 with Priority: HIGHEST for action security_group_rules [ 689.016131] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-172bf292-f948-416d-8b6b-b5776cb9e283 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.016131] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-172bf292-f948-416d-8b6b-b5776cb9e283" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.016131] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-172bf292-f948-416d-8b6b-b5776cb9e283" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.016131] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-172bf292-f948-416d-8b6b-b5776cb9e283" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.016131] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('172bf292-f948-416d-8b6b-b5776cb9e283',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.164230] env[65783]: INFO networking_nsxv3.common.synchronization [None req-1301c0bd-2a5b-4068-8612-5bcd43b8f476 tempest-MigrationsAdminTest-1412758904 tempest-MigrationsAdminTest-1412758904-project-member] Enqueued Resource ID: 172bf292-f948-416d-8b6b-b5776cb9e283 with Priority: HIGHEST for action security_group_rules [ 689.165167] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 172bf292-f948-416d-8b6b-b5776cb9e283 with Priority: HIGHEST for action security_group_rules [ 689.165167] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-172bf292-f948-416d-8b6b-b5776cb9e283 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.165167] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-172bf292-f948-416d-8b6b-b5776cb9e283" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.304207] env[65783]: INFO networking_nsxv3.common.synchronization [req-aebdf7ee-ac0e-4ebe-9811-71ee1b9f0108 req-8c82c831-9203-4eea-96a1-e43cb96beee6 tempest-SecurityGroupRulesTestJSON-1774018064 tempest-SecurityGroupRulesTestJSON-1774018064-project-member] Enqueued Resource ID: 54bea1b7-3652-4c42-9a15-d68d0740e2da with Priority: HIGHEST for action security_group_rules [ 689.305343] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54bea1b7-3652-4c42-9a15-d68d0740e2da with Priority: HIGHEST for action security_group_rules [ 689.308351] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54bea1b7-3652-4c42-9a15-d68d0740e2da taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.308351] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54bea1b7-3652-4c42-9a15-d68d0740e2da" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.308351] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54bea1b7-3652-4c42-9a15-d68d0740e2da" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.308351] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54bea1b7-3652-4c42-9a15-d68d0740e2da" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.308351] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54bea1b7-3652-4c42-9a15-d68d0740e2da',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.434722] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 42a7074e-6547-4c88-96e5-693f66c36882 with status ACTIVE [ 689.434722] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.434722] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.434722] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.434722] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.434722] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.440102] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.440102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.440102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.440102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.440102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.440102] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.440102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.440102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.440102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.440102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.440102] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 42a7074e-6547-4c88-96e5-693f66c36882 is going to be updated. [ 689.440102] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.440102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.468963] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.468963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.468963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.468963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.468963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.468963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42a7074e-6547-4c88-96e5-693f66c36882" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.544598] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.544709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.544758] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.545385] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.546019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.546019] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 172bf292-f948-416d-8b6b-b5776cb9e283 already deleted. [ 689.546019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-172bf292-f948-416d-8b6b-b5776cb9e283" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.546755] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-172bf292-f948-416d-8b6b-b5776cb9e283" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.546968] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-172bf292-f948-416d-8b6b-b5776cb9e283" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.547818] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('172bf292-f948-416d-8b6b-b5776cb9e283',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.690071] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: SUCCESS [ 689.690340] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 deletion is rescheduled due to dependency. [ 689.690513] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.690751] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.690970] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.691174] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.691314] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.691458] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.691582] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.691687] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.691823] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.830125] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.830406] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.830478] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.830721] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.830834] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.830907] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54bea1b7-3652-4c42-9a15-d68d0740e2da already deleted. [ 689.831033] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54bea1b7-3652-4c42-9a15-d68d0740e2da" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.078194] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.078352] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.078352] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.078628] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.078716] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.078809] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 172bf292-f948-416d-8b6b-b5776cb9e283 already deleted. [ 690.078891] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-172bf292-f948-416d-8b6b-b5776cb9e283" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.194867] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.698259] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.719772] env[65783]: INFO networking_nsxv3.common.synchronization [None req-dcf62087-46fc-4e0a-9e14-be9faba755d6 None None] Enqueued Resource ID: 006cc3b6-6a29-4ede-b304-204e133bc49c with Priority: HIGHEST for action port [ 690.720960] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 006cc3b6-6a29-4ede-b304-204e133bc49c with Priority: HIGHEST for action port [ 690.721489] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-006cc3b6-6a29-4ede-b304-204e133bc49c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.721594] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-006cc3b6-6a29-4ede-b304-204e133bc49c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.721644] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-006cc3b6-6a29-4ede-b304-204e133bc49c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.721905] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-006cc3b6-6a29-4ede-b304-204e133bc49c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.721989] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('006cc3b6-6a29-4ede-b304-204e133bc49c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.989552] env[65783]: INFO networking_nsxv3.common.synchronization [None req-43b46661-c121-4b28-b8eb-b1eddab22bcb tempest-ServerActionsV293TestJSON-1619444112 tempest-ServerActionsV293TestJSON-1619444112-project-member] Enqueued Resource ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 with Priority: HIGHEST for action security_group_rules [ 690.990454] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 with Priority: HIGHEST for action security_group_rules [ 690.991092] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d62819d6-c7c5-47a8-a028-a438cb9528b5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.991321] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.991448] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.991810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.992801] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d62819d6-c7c5-47a8-a028-a438cb9528b5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.202196] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.202712] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.202712] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.202806] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.202940] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.203046] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 is going to be updated. [ 691.225095] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 006cc3b6-6a29-4ede-b304-204e133bc49c [ 691.225356] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.225668] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.225668] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.226936] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.226936] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.226936] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:006cc3b6-6a29-4ede-b304-204e133bc49c already deleted. [ 691.226936] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-006cc3b6-6a29-4ede-b304-204e133bc49c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.238417] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.238576] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.238653] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.238903] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.239605] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.252380] env[65783]: INFO networking_nsxv3.common.synchronization [req-870b8f98-3dce-4028-8a8d-e9a7157d91b6 req-379f9c05-f244-40e9-a026-77a39c5cd274 tempest-ServerGroupTestJSON-559816597 tempest-ServerGroupTestJSON-559816597-project-member] Enqueued Resource ID: 29c3066f-92d6-4fd9-a20b-96651c82bc4b with Priority: HIGHEST for action security_group_members [ 691.253560] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: IN_PROGRESS for 2s [ 691.254115] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29c3066f-92d6-4fd9-a20b-96651c82bc4b with Priority: HIGHEST for action security_group_members [ 691.254434] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-29c3066f-92d6-4fd9-a20b-96651c82bc4b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.254656] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.254723] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.257469] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.257469] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.257469] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.257469] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.257469] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.257469] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.257469] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29c3066f-92d6-4fd9-a20b-96651c82bc4b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.411875] env[65783]: INFO networking_nsxv3.common.synchronization [None req-50ea9dd9-efe8-4506-90ea-9f441e103967 tempest-ServerActionsV293TestJSON-1619444112 tempest-ServerActionsV293TestJSON-1619444112-project-member] Enqueued Resource ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 with Priority: HIGHEST for action security_group_rules [ 691.413499] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 with Priority: HIGHEST for action security_group_rules [ 691.414214] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d62819d6-c7c5-47a8-a028-a438cb9528b5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.414652] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.433219] env[65783]: INFO networking_nsxv3.common.synchronization [None req-8b72616a-b9d8-43ae-9a54-6ea4827f990f None None] Enqueued Resource ID: 0805bfd7-dd94-4111-96e1-0ee02edbb58b with Priority: HIGHEST for action port [ 691.433781] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0805bfd7-dd94-4111-96e1-0ee02edbb58b with Priority: HIGHEST for action port [ 691.434231] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-0805bfd7-dd94-4111-96e1-0ee02edbb58b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.434366] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0805bfd7-dd94-4111-96e1-0ee02edbb58b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.434441] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0805bfd7-dd94-4111-96e1-0ee02edbb58b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.434690] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0805bfd7-dd94-4111-96e1-0ee02edbb58b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.434774] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0805bfd7-dd94-4111-96e1-0ee02edbb58b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.515484] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.515615] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.515700] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.515922] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.515969] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.516077] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 already deleted. [ 691.516155] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.516348] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.516484] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.516579] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d62819d6-c7c5-47a8-a028-a438cb9528b5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.758745] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.758745] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.758745] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.758950] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.758950] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.759101] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.759199] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.759254] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.759397] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.759512] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.761476] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29c3066f-92d6-4fd9-a20b-96651c82bc4b is going to be updated. [ 691.814072] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.814575] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.814575] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.814575] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.814692] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.825389] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29c3066f-92d6-4fd9-a20b-96651c82bc4b in Status: IN_PROGRESS for 2s [ 691.938667] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0805bfd7-dd94-4111-96e1-0ee02edbb58b [ 691.938906] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.939073] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.939138] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.939353] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.939467] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.940091] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0805bfd7-dd94-4111-96e1-0ee02edbb58b already deleted. [ 691.940091] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0805bfd7-dd94-4111-96e1-0ee02edbb58b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.040693] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.041042] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.041214] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.041536] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.042210] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.042401] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 already deleted. [ 692.042561] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.870106] env[65783]: INFO networking_nsxv3.common.synchronization [req-ce8c82fc-8cc2-431b-b35e-87f6623f6809 req-dc69e493-069f-49a8-8ec0-2534aeb94b53 tempest-ServerActionsTestOtherA-298845163 tempest-ServerActionsTestOtherA-298845163-project-member] Enqueued Resource ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 with Priority: HIGHEST for action security_group_members [ 692.870106] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 with Priority: HIGHEST for action security_group_members [ 692.870106] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.870106] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.870106] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.870106] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.870697] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.870697] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.870697] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.871404] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.871404] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.871404] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6dc57fb-f44d-4b26-87fe-bb8e4df202a8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.265692] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: SUCCESS [ 693.265692] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.265692] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.265974] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.267169] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.267169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.267169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.267169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.267169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.267169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.267169] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.376324] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.378024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.378024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.378024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.378024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.378024] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.378024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.378024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.378024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.378024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.378024] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 already deleted. [ 693.378024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.413945] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-678 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.413945] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-678" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.416272] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-678" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.416272] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-678" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.416518] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.416744] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.416802] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.417097] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.418133] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.418393] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 693.418524] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 693.418636] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 693.418741] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 693.418847] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 693.418947] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 693.419095] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 693.443662] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 693.443964] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 693.444319] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 693.444627] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-678" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.445118] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-02852d45-877c-40ee-ade8-47cadad62cf6 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.445446] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-02852d45-877c-40ee-ade8-47cadad62cf6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.445642] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-02852d45-877c-40ee-ade8-47cadad62cf6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.446169] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-02852d45-877c-40ee-ade8-47cadad62cf6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.446473] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02852d45-877c-40ee-ade8-47cadad62cf6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.771174] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.771363] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.771421] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.771701] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.771890] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.771982] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.772057] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.772221] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.772336] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.772475] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.772568] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.772703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.772767] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.772924] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.773107] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.773204] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.773255] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.773402] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.773460] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.773658] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.773764] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.841269] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29c3066f-92d6-4fd9-a20b-96651c82bc4b in Status: SUCCESS [ 693.841269] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29c3066f-92d6-4fd9-a20b-96651c82bc4b deletion is rescheduled due to dependency. [ 693.841269] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.949861] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.950253] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.950341] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.950673] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.950848] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.951031] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 02852d45-877c-40ee-ade8-47cadad62cf6 not found, creating... [ 693.951336] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.951526] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.951690] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.951936] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.952158] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.952592] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.953259] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.953802] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.954394] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.954836] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.955065] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 02852d45-877c-40ee-ade8-47cadad62cf6 is going to be created. [ 693.981457] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.981457] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.981457] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.981831] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.982513] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.982513] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-02852d45-877c-40ee-ade8-47cadad62cf6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.026328] env[65783]: INFO networking_nsxv3.common.synchronization [req-23499200-7fa1-455f-98fa-b7c1ff86a7b9 req-c6880882-b335-4abf-9e63-2e974a00dc11 tempest-SecurityGroupRulesTestJSON-1774018064 tempest-SecurityGroupRulesTestJSON-1774018064-project-member] Enqueued Resource ID: 150df013-02e9-4909-956a-53ef9bad34c9 with Priority: HIGHEST for action security_group_rules [ 694.026629] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 150df013-02e9-4909-956a-53ef9bad34c9 with Priority: HIGHEST for action security_group_rules [ 694.027034] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-150df013-02e9-4909-956a-53ef9bad34c9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.030449] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-150df013-02e9-4909-956a-53ef9bad34c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.030449] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-150df013-02e9-4909-956a-53ef9bad34c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.030449] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-150df013-02e9-4909-956a-53ef9bad34c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.030449] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('150df013-02e9-4909-956a-53ef9bad34c9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.218407] env[65783]: INFO networking_nsxv3.common.synchronization [None req-877435d0-4cc3-4220-b4e8-e960700009ba None None] Enqueued Resource ID: ec79889e-2e43-47b5-b18c-935ccdd650ce with Priority: HIGHEST for action port [ 694.219046] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec79889e-2e43-47b5-b18c-935ccdd650ce with Priority: HIGHEST for action port [ 694.219767] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec79889e-2e43-47b5-b18c-935ccdd650ce taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.219767] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec79889e-2e43-47b5-b18c-935ccdd650ce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.219767] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec79889e-2e43-47b5-b18c-935ccdd650ce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.220078] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec79889e-2e43-47b5-b18c-935ccdd650ce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.220078] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec79889e-2e43-47b5-b18c-935ccdd650ce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.276580] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9943d881-28bf-4885-906c-d360f9c2c3e7: rpc.has_security_group_logging(os_id): False [ 694.300665] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.300831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.300891] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.301118] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.301233] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.301448] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.301569] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.301658] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.301889] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.302132] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.302307] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.302412] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.302474] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.302622] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.302696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.302876] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.302962] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.303024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.303245] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.303245] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.303360] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 is going to be updated. [ 694.392782] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.393064] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.393190] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.393657] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.393758] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.419726] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: IN_PROGRESS for 2s [ 694.570623] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.570845] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.570845] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.571081] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.571174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.571280] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 150df013-02e9-4909-956a-53ef9bad34c9 already deleted. [ 694.571411] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-150df013-02e9-4909-956a-53ef9bad34c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.725299] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec79889e-2e43-47b5-b18c-935ccdd650ce [ 694.725544] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.725716] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.725797] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.726043] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.726135] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.726252] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec79889e-2e43-47b5-b18c-935ccdd650ce already deleted. [ 694.726394] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec79889e-2e43-47b5-b18c-935ccdd650ce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.824428] env[65783]: INFO networking_nsxv3.common.synchronization [req-ce8c82fc-8cc2-431b-b35e-87f6623f6809 req-97f002f4-b571-4ee1-852a-5b17fca6be8e service nova] Enqueued Resource ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 with Priority: HIGHEST for action security_group_rules [ 694.824636] env[65783]: INFO networking_nsxv3.common.synchronization [req-ce8c82fc-8cc2-431b-b35e-87f6623f6809 req-97f002f4-b571-4ee1-852a-5b17fca6be8e service nova] Enqueued Resource ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 with Priority: HIGHEST for action security_group_members [ 694.825097] env[65783]: INFO networking_nsxv3.common.synchronization [req-ce8c82fc-8cc2-431b-b35e-87f6623f6809 req-97f002f4-b571-4ee1-852a-5b17fca6be8e service nova] Enqueued Resource ID: 02852d45-877c-40ee-ade8-47cadad62cf6 with Priority: HIGHEST for action port [ 694.828023] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 with Priority: HIGHEST for action security_group_rules [ 694.828201] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 with Priority: HIGHEST for action security_group_members [ 694.828307] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02852d45-877c-40ee-ade8-47cadad62cf6 with Priority: HIGHEST for action port [ 694.828759] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.828976] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.829086] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.829592] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.829592] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6dc57fb-f44d-4b26-87fe-bb8e4df202a8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.832512] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.832688] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.832688] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.832893] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.833087] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.833189] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.833228] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.833396] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.833500] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.833604] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6dc57fb-f44d-4b26-87fe-bb8e4df202a8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.836502] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-02852d45-877c-40ee-ade8-47cadad62cf6 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.836612] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02852d45-877c-40ee-ade8-47cadad62cf6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.836647] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02852d45-877c-40ee-ade8-47cadad62cf6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.836815] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02852d45-877c-40ee-ade8-47cadad62cf6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.836887] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02852d45-877c-40ee-ade8-47cadad62cf6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.860168] env[65783]: INFO networking_nsxv3.common.synchronization [req-0a3ae059-b8d3-44aa-b2a1-be1b712286a1 req-c2497a4c-3996-474b-a8d4-193a845ebdcb tempest-FloatingIPsAssociationNegativeTestJSON-2090197600 tempest-FloatingIPsAssociationNegativeTestJSON-2090197600-project-member] Enqueued Resource ID: 40fa215c-6810-4862-9ddc-1bca888b2ee5 with Priority: HIGHEST for action security_group_members [ 694.860457] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40fa215c-6810-4862-9ddc-1bca888b2ee5 with Priority: HIGHEST for action security_group_members [ 694.860977] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-40fa215c-6810-4862-9ddc-1bca888b2ee5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.861193] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.861331] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.861643] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.861932] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.862207] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.862350] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.862600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.862777] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.862947] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40fa215c-6810-4862-9ddc-1bca888b2ee5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.338846] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.339161] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.339296] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6dc57fb-f44d-4b26-87fe-bb8e4df202a8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.342224] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 02852d45-877c-40ee-ade8-47cadad62cf6 with status ACTIVE [ 695.342224] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.342224] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.342224] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.342224] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.342224] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.342224] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.342224] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.342224] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.342224] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.342224] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.342224] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.342224] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.342224] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.342224] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.343871] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.343871] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 02852d45-877c-40ee-ade8-47cadad62cf6 is going to be updated. [ 695.366922] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.367136] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.367207] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.367605] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.367673] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.367900] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.368011] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.368107] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.368246] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.368400] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.368511] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40fa215c-6810-4862-9ddc-1bca888b2ee5 is going to be updated. [ 695.372119] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.372119] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.372119] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.372119] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.372119] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.372374] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02852d45-877c-40ee-ade8-47cadad62cf6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.406424] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.406424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.406604] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.407618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.407618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.417768] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40fa215c-6810-4862-9ddc-1bca888b2ee5 in Status: IN_PROGRESS for 2s [ 695.516646] env[65783]: INFO networking_nsxv3.common.synchronization [req-8ad78328-eb0f-4f72-b55b-d9b40fcb54d0 req-b92808aa-9e87-481a-9df0-cb119c4fd44a tempest-ServersTestJSON-1142340636 tempest-ServersTestJSON-1142340636-project-member] Enqueued Resource ID: 14427d59-3459-4ddd-9c42-78877a31172d with Priority: HIGHEST for action security_group_members [ 695.517448] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14427d59-3459-4ddd-9c42-78877a31172d with Priority: HIGHEST for action security_group_members [ 695.517662] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-14427d59-3459-4ddd-9c42-78877a31172d taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.517791] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.517859] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.519788] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.520027] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.520156] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.520222] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.520813] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.520994] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.521718] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14427d59-3459-4ddd-9c42-78877a31172d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.846507] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6dc57fb-f44d-4b26-87fe-bb8e4df202a8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.955046] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-349 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.955046] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-349" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.955046] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-349" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.955046] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-349" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.955046] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.955046] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.955046] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.955525] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.955525] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.955635] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 695.955767] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 695.955871] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 695.956367] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 695.956509] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 695.956622] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 695.956835] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 695.979559] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 695.980676] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 695.981051] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 695.982131] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-349" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.982131] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-f24d1ba6-c026-4b7b-ab0c-ad67cb1fc5f8 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.982131] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-f24d1ba6-c026-4b7b-ab0c-ad67cb1fc5f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.982131] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-f24d1ba6-c026-4b7b-ab0c-ad67cb1fc5f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.982572] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-f24d1ba6-c026-4b7b-ab0c-ad67cb1fc5f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.982572] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f24d1ba6-c026-4b7b-ab0c-ad67cb1fc5f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.026018] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.026722] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.026722] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.026822] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.027049] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.027255] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.027832] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.027832] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.027832] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.027942] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.028674] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14427d59-3459-4ddd-9c42-78877a31172d already deleted. [ 696.028674] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.349218] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.349548] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.349548] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.349687] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.350982] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.350982] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 is going to be created. [ 696.377317] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.377484] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.377484] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.377702] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.377853] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.389776] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 in Status: UNINITIALIZED for 2s [ 696.436934] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: SUCCESS [ 696.437296] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.484986] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.485323] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.485407] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.485826] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.486011] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.486219] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port f24d1ba6-c026-4b7b-ab0c-ad67cb1fc5f8 not found, creating... [ 696.486603] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.486810] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.486920] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.487192] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.487323] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.487627] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.487790] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.487942] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.488180] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.488307] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.488445] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: f24d1ba6-c026-4b7b-ab0c-ad67cb1fc5f8 is going to be created. [ 696.514237] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.514487] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.514609] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.514899] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.515229] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.515471] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-f24d1ba6-c026-4b7b-ab0c-ad67cb1fc5f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.246686] env[65783]: INFO networking_nsxv3.common.synchronization [req-8ad78328-eb0f-4f72-b55b-d9b40fcb54d0 req-f0ff79c8-ceb0-4afd-b1ac-7685459b32e2 service nova] Enqueued Resource ID: 14427d59-3459-4ddd-9c42-78877a31172d with Priority: HIGHEST for action security_group_rules [ 697.246820] env[65783]: INFO networking_nsxv3.common.synchronization [req-8ad78328-eb0f-4f72-b55b-d9b40fcb54d0 req-f0ff79c8-ceb0-4afd-b1ac-7685459b32e2 service nova] Enqueued Resource ID: 14427d59-3459-4ddd-9c42-78877a31172d with Priority: HIGHEST for action security_group_members [ 697.246992] env[65783]: INFO networking_nsxv3.common.synchronization [req-8ad78328-eb0f-4f72-b55b-d9b40fcb54d0 req-f0ff79c8-ceb0-4afd-b1ac-7685459b32e2 service nova] Enqueued Resource ID: f24d1ba6-c026-4b7b-ab0c-ad67cb1fc5f8 with Priority: HIGHEST for action port [ 697.247550] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14427d59-3459-4ddd-9c42-78877a31172d with Priority: HIGHEST for action security_group_rules [ 697.247687] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14427d59-3459-4ddd-9c42-78877a31172d with Priority: HIGHEST for action security_group_members [ 697.247778] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f24d1ba6-c026-4b7b-ab0c-ad67cb1fc5f8 with Priority: HIGHEST for action port [ 697.248563] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14427d59-3459-4ddd-9c42-78877a31172d taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.248563] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.248729] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.248803] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.248878] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14427d59-3459-4ddd-9c42-78877a31172d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.250509] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-14427d59-3459-4ddd-9c42-78877a31172d taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.250602] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.250641] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.252029] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.252029] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.252029] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.252029] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.252029] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.252029] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.252029] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14427d59-3459-4ddd-9c42-78877a31172d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.252834] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-f24d1ba6-c026-4b7b-ab0c-ad67cb1fc5f8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.252932] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f24d1ba6-c026-4b7b-ab0c-ad67cb1fc5f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.253318] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f24d1ba6-c026-4b7b-ab0c-ad67cb1fc5f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.253318] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f24d1ba6-c026-4b7b-ab0c-ad67cb1fc5f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.253318] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f24d1ba6-c026-4b7b-ab0c-ad67cb1fc5f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.428182] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40fa215c-6810-4862-9ddc-1bca888b2ee5 in Status: SUCCESS [ 697.428723] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40fa215c-6810-4862-9ddc-1bca888b2ee5 deletion is rescheduled due to dependency. [ 697.428723] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.756495] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-14427d59-3459-4ddd-9c42-78877a31172d taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.756630] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.756833] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14427d59-3459-4ddd-9c42-78877a31172d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.757814] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f24d1ba6-c026-4b7b-ab0c-ad67cb1fc5f8 with status ACTIVE [ 697.758032] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.758173] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.758261] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.758431] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.758566] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.758905] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.758905] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.759032] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.759104] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.759183] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.759361] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.759457] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.759508] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.759654] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.759726] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.759807] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f24d1ba6-c026-4b7b-ab0c-ad67cb1fc5f8 is going to be updated. [ 697.803384] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.803601] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.803601] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.803835] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.803977] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.804164] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f24d1ba6-c026-4b7b-ab0c-ad67cb1fc5f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.172065] env[65783]: INFO networking_nsxv3.common.synchronization [req-7fdffb2e-e40d-45d9-b94f-9ab9f21aab4b req-9578b851-3983-4973-870b-3f5ad073b17f tempest-ServersV294TestFqdnHostnames-1151149332 tempest-ServersV294TestFqdnHostnames-1151149332-project-member] Enqueued Resource ID: 752cf951-e22b-4bfc-b89a-6766804d295f with Priority: HIGHEST for action security_group_members [ 698.172484] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 752cf951-e22b-4bfc-b89a-6766804d295f with Priority: HIGHEST for action security_group_members [ 698.173480] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-752cf951-e22b-4bfc-b89a-6766804d295f taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.173480] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.173480] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.173480] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.173480] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.173480] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.173480] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.174011] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.174011] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.174011] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('752cf951-e22b-4bfc-b89a-6766804d295f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.264139] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14427d59-3459-4ddd-9c42-78877a31172d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.288692] env[65783]: INFO networking_nsxv3.common.synchronization [None req-dc8491a4-9e97-4bc6-afed-d530b88f36d8 None None] Enqueued Resource ID: b0c5b57f-e677-4ad0-a71c-d6aaddaf8575 with Priority: HIGHEST for action port [ 698.289283] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0c5b57f-e677-4ad0-a71c-d6aaddaf8575 with Priority: HIGHEST for action port [ 698.289588] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0c5b57f-e677-4ad0-a71c-d6aaddaf8575 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.289764] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0c5b57f-e677-4ad0-a71c-d6aaddaf8575" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.289764] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0c5b57f-e677-4ad0-a71c-d6aaddaf8575" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.290106] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0c5b57f-e677-4ad0-a71c-d6aaddaf8575" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.290202] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0c5b57f-e677-4ad0-a71c-d6aaddaf8575',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.401024] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 in Status: SUCCESS [ 698.403206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.403206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.403206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.403206] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.403206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.403206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.403206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.403206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.403206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.403206] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c6dc57fb-f44d-4b26-87fe-bb8e4df202a8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.556730] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-723 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.557112] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-723" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.557112] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-723" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.557358] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-723" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.557628] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.557801] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.557923] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.558796] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.559016] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.559298] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.559503] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 698.559599] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 698.559748] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 698.559899] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.560075] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 698.560266] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 698.583432] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 698.583735] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 698.583865] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 698.584373] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-723" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.584769] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-fcafb23d-cf58-408a-86ee-d14ae37c1bda taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.585041] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-fcafb23d-cf58-408a-86ee-d14ae37c1bda" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.585225] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-fcafb23d-cf58-408a-86ee-d14ae37c1bda" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.585889] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-fcafb23d-cf58-408a-86ee-d14ae37c1bda" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.586103] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcafb23d-cf58-408a-86ee-d14ae37c1bda',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.676247] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.676480] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.676647] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.676858] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.676983] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.677255] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.677401] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.677498] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.677707] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.677817] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.677937] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 752cf951-e22b-4bfc-b89a-6766804d295f already deleted. [ 698.678078] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.767437] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.767437] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.767437] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.767660] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.767805] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.767949] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14427d59-3459-4ddd-9c42-78877a31172d is going to be created. [ 698.793371] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b0c5b57f-e677-4ad0-a71c-d6aaddaf8575 [ 698.793510] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.793650] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.793917] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.794841] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.794841] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.794841] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b0c5b57f-e677-4ad0-a71c-d6aaddaf8575 already deleted. [ 698.794841] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0c5b57f-e677-4ad0-a71c-d6aaddaf8575" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.795737] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.795863] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.795974] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.796174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.796327] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.811513] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14427d59-3459-4ddd-9c42-78877a31172d in Status: UNINITIALIZED for 2s [ 698.906269] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.906526] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.906526] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.906785] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.906958] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.907169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.907255] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.907414] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.907504] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.907594] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.907739] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.907833] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.907893] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.908056] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.908390] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.908526] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.908582] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.908722] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.908797] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.908889] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.908972] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c6dc57fb-f44d-4b26-87fe-bb8e4df202a8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.089305] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.089527] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.089625] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.089897] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.090048] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.090198] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port fcafb23d-cf58-408a-86ee-d14ae37c1bda not found, creating... [ 699.090448] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.090656] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.090765] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.090979] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.091118] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.091385] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.091556] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.091690] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.091910] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.092112] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.092214] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: fcafb23d-cf58-408a-86ee-d14ae37c1bda is going to be created. [ 699.115530] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.115832] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.116018] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.116396] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.116723] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.117047] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-fcafb23d-cf58-408a-86ee-d14ae37c1bda" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.411022] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c6dc57fb-f44d-4b26-87fe-bb8e4df202a8: rpc.has_security_group_logging(os_id): False [ 699.430912] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.431116] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.431213] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.431503] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.431633] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.431857] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.431991] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.432116] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.432291] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.432375] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.432669] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.432770] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.432836] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.432996] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.433179] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.433358] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.433500] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.433575] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.433757] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.433878] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.433986] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 is going to be created. [ 699.497183] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.497409] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.497409] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.497612] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.497852] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.511088] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 in Status: IN_PROGRESS for 2s [ 699.915170] env[65783]: INFO networking_nsxv3.common.synchronization [req-7fdffb2e-e40d-45d9-b94f-9ab9f21aab4b req-a6e9c578-1a2c-4871-a134-ee7c1c98ea0a service nova] Enqueued Resource ID: 752cf951-e22b-4bfc-b89a-6766804d295f with Priority: HIGHEST for action security_group_rules [ 699.915475] env[65783]: INFO networking_nsxv3.common.synchronization [req-7fdffb2e-e40d-45d9-b94f-9ab9f21aab4b req-a6e9c578-1a2c-4871-a134-ee7c1c98ea0a service nova] Enqueued Resource ID: 752cf951-e22b-4bfc-b89a-6766804d295f with Priority: HIGHEST for action security_group_members [ 699.915619] env[65783]: INFO networking_nsxv3.common.synchronization [req-7fdffb2e-e40d-45d9-b94f-9ab9f21aab4b req-a6e9c578-1a2c-4871-a134-ee7c1c98ea0a service nova] Enqueued Resource ID: fcafb23d-cf58-408a-86ee-d14ae37c1bda with Priority: HIGHEST for action port [ 699.916813] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 752cf951-e22b-4bfc-b89a-6766804d295f with Priority: HIGHEST for action security_group_rules [ 699.916961] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 752cf951-e22b-4bfc-b89a-6766804d295f with Priority: HIGHEST for action security_group_members [ 699.919024] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcafb23d-cf58-408a-86ee-d14ae37c1bda with Priority: HIGHEST for action port [ 699.919024] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-752cf951-e22b-4bfc-b89a-6766804d295f taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.919024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.919024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.919024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.919024] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('752cf951-e22b-4bfc-b89a-6766804d295f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.920789] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-752cf951-e22b-4bfc-b89a-6766804d295f taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.920789] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.920789] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.920789] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.920789] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.920789] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.921350] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.921350] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.921350] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.921350] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('752cf951-e22b-4bfc-b89a-6766804d295f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.924166] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcafb23d-cf58-408a-86ee-d14ae37c1bda taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.924166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcafb23d-cf58-408a-86ee-d14ae37c1bda" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.924166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcafb23d-cf58-408a-86ee-d14ae37c1bda" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.924166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcafb23d-cf58-408a-86ee-d14ae37c1bda" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.924166] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcafb23d-cf58-408a-86ee-d14ae37c1bda',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.425247] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-752cf951-e22b-4bfc-b89a-6766804d295f taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.425432] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.429013] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fcafb23d-cf58-408a-86ee-d14ae37c1bda with status ACTIVE [ 700.429262] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.429391] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.429488] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.429720] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.429810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.430013] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.430143] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.430189] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.430383] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.430419] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.430688] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.430787] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.430864] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.430987] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.431080] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.431163] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fcafb23d-cf58-408a-86ee-d14ae37c1bda is going to be updated. [ 700.433256] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('752cf951-e22b-4bfc-b89a-6766804d295f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.458475] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.458867] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.458867] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.458973] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.459838] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.459838] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcafb23d-cf58-408a-86ee-d14ae37c1bda" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.825856] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14427d59-3459-4ddd-9c42-78877a31172d in Status: SUCCESS [ 700.826104] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.826318] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.826611] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.826874] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.827030] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.827133] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.827316] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.827527] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.827572] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.827682] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14427d59-3459-4ddd-9c42-78877a31172d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.830650] env[65783]: INFO networking_nsxv3.common.synchronization [req-f6ca6f1f-03ab-4875-b87b-d6555f74bb03 req-4f7aa91d-d58c-421f-aaa6-c936741a5165 tempest-ServersAdminTestJSON-345343376 tempest-ServersAdminTestJSON-345343376-project-member] Enqueued Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_members [ 700.831390] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_members [ 700.832037] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca99b1a6-3702-4011-942b-06036fda2165 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.832037] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.832210] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.832315] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.832479] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.832578] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.832640] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.832809] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.832900] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.832993] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.934963] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('752cf951-e22b-4bfc-b89a-6766804d295f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.069819] env[65783]: INFO networking_nsxv3.common.synchronization [None req-010e66a7-e1d0-429c-9db9-d2c7f672590b None None] Enqueued Resource ID: 5518558f-3e81-43af-bbb7-5a39c40a5b72 with Priority: HIGHEST for action port [ 701.070455] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5518558f-3e81-43af-bbb7-5a39c40a5b72 with Priority: HIGHEST for action port [ 701.070791] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-5518558f-3e81-43af-bbb7-5a39c40a5b72 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.070944] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5518558f-3e81-43af-bbb7-5a39c40a5b72" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.071012] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5518558f-3e81-43af-bbb7-5a39c40a5b72" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.073578] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5518558f-3e81-43af-bbb7-5a39c40a5b72" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.073578] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5518558f-3e81-43af-bbb7-5a39c40a5b72',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.269875] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-714 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.270153] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-714" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.270153] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-714" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.270330] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-714" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.270917] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.271846] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.272221] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.272509] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.272680] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.272926] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 701.273072] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 701.273251] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 701.273330] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 701.273453] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 701.273558] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 701.273698] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 701.296951] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 701.297155] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 701.297298] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 701.297469] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-714" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.297826] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-83cd356c-b01d-42de-8d7b-a6b5cde9d80d taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.297987] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-83cd356c-b01d-42de-8d7b-a6b5cde9d80d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.298118] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-83cd356c-b01d-42de-8d7b-a6b5cde9d80d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.298490] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-83cd356c-b01d-42de-8d7b-a6b5cde9d80d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.298644] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83cd356c-b01d-42de-8d7b-a6b5cde9d80d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.332013] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14427d59-3459-4ddd-9c42-78877a31172d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.336311] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.439411] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.439666] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.439728] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.439987] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.440041] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.440157] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 752cf951-e22b-4bfc-b89a-6766804d295f is going to be created. [ 701.466111] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.466256] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.466371] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.466646] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.466920] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.477826] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 752cf951-e22b-4bfc-b89a-6766804d295f in Status: UNINITIALIZED for 2s [ 701.526928] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 in Status: SUCCESS [ 701.526928] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.575480] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5518558f-3e81-43af-bbb7-5a39c40a5b72 [ 701.575766] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.575908] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.575976] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.576222] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.576312] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.576420] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5518558f-3e81-43af-bbb7-5a39c40a5b72 already deleted. [ 701.576474] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5518558f-3e81-43af-bbb7-5a39c40a5b72" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.791709] env[65783]: INFO networking_nsxv3.common.synchronization [req-5dd8c9bc-a852-4004-8a92-0b5a2d6338f9 req-4bd438f7-d351-4884-a99a-3b596b740ad5 tempest-SecurityGroupRulesTestJSON-1774018064 tempest-SecurityGroupRulesTestJSON-1774018064-project-member] Enqueued Resource ID: 453c0f1f-7ac6-42cc-8535-282a9f128945 with Priority: HIGHEST for action security_group_rules [ 701.791709] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 453c0f1f-7ac6-42cc-8535-282a9f128945 with Priority: HIGHEST for action security_group_rules [ 701.791709] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-453c0f1f-7ac6-42cc-8535-282a9f128945 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.791709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-453c0f1f-7ac6-42cc-8535-282a9f128945" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.791709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-453c0f1f-7ac6-42cc-8535-282a9f128945" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.792362] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-453c0f1f-7ac6-42cc-8535-282a9f128945" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.792576] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('453c0f1f-7ac6-42cc-8535-282a9f128945',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.802182] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.806024] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.806024] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.806024] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.806024] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.806024] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 83cd356c-b01d-42de-8d7b-a6b5cde9d80d not found, creating... [ 701.806024] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.806024] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.806024] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.806024] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.806024] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.806517] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.806517] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.806517] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.806517] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.806517] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.806517] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 83cd356c-b01d-42de-8d7b-a6b5cde9d80d is going to be created. [ 701.827423] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.827637] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.827637] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.828267] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.828267] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.828404] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-83cd356c-b01d-42de-8d7b-a6b5cde9d80d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.834330] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14427d59-3459-4ddd-9c42-78877a31172d: rpc.has_security_group_logging(os_id): False [ 701.838586] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.858079] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.858187] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.859179] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.859179] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.859179] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.859179] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.859179] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.859179] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.859179] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.859179] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.859770] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14427d59-3459-4ddd-9c42-78877a31172d is going to be created. [ 701.956700] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.957185] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.957185] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.957185] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.957337] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.973801] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14427d59-3459-4ddd-9c42-78877a31172d in Status: IN_PROGRESS for 2s [ 702.330242] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.330242] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.330242] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.330242] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.330242] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.330242] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 453c0f1f-7ac6-42cc-8535-282a9f128945 already deleted. [ 702.330242] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-453c0f1f-7ac6-42cc-8535-282a9f128945" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.342256] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.342256] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.342367] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.342606] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.342739] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.342871] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca99b1a6-3702-4011-942b-06036fda2165 is going to be updated. [ 702.390261] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.390479] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.390641] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.390923] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.391151] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.411028] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: IN_PROGRESS for 2s [ 702.673680] env[65783]: INFO networking_nsxv3.common.synchronization [req-f6ca6f1f-03ab-4875-b87b-d6555f74bb03 req-59145f3a-0bb1-4992-b966-b4888aea6013 service nova] Enqueued Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_rules [ 702.673870] env[65783]: INFO networking_nsxv3.common.synchronization [req-f6ca6f1f-03ab-4875-b87b-d6555f74bb03 req-59145f3a-0bb1-4992-b966-b4888aea6013 service nova] Enqueued Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_members [ 702.674012] env[65783]: INFO networking_nsxv3.common.synchronization [req-f6ca6f1f-03ab-4875-b87b-d6555f74bb03 req-59145f3a-0bb1-4992-b966-b4888aea6013 service nova] Enqueued Resource ID: 83cd356c-b01d-42de-8d7b-a6b5cde9d80d with Priority: HIGHEST for action port [ 702.674596] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_rules [ 702.674741] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_members [ 702.674843] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83cd356c-b01d-42de-8d7b-a6b5cde9d80d with Priority: HIGHEST for action port [ 702.678152] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca99b1a6-3702-4011-942b-06036fda2165 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.678441] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.678441] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.678612] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.678685] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.679879] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca99b1a6-3702-4011-942b-06036fda2165 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.679879] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.680030] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-83cd356c-b01d-42de-8d7b-a6b5cde9d80d taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.680147] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83cd356c-b01d-42de-8d7b-a6b5cde9d80d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.680195] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83cd356c-b01d-42de-8d7b-a6b5cde9d80d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.680383] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83cd356c-b01d-42de-8d7b-a6b5cde9d80d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.680441] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83cd356c-b01d-42de-8d7b-a6b5cde9d80d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.182519] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca99b1a6-3702-4011-942b-06036fda2165 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.182859] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.186106] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83cd356c-b01d-42de-8d7b-a6b5cde9d80d with status ACTIVE [ 703.186377] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.186527] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.186611] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.186838] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.186941] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.187112] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.187217] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.187307] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.187490] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.187584] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.187771] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.187876] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.187938] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.188124] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.188204] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.189682] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83cd356c-b01d-42de-8d7b-a6b5cde9d80d is going to be updated. [ 703.212564] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.212716] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.212759] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.213337] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.213337] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.213337] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83cd356c-b01d-42de-8d7b-a6b5cde9d80d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.489025] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 752cf951-e22b-4bfc-b89a-6766804d295f in Status: SUCCESS [ 703.489097] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.489256] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.489470] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.489698] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.490418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.490418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.490418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.490418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.490418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.490418] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('752cf951-e22b-4bfc-b89a-6766804d295f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.865729] env[65783]: INFO networking_nsxv3.common.synchronization [req-4b36b935-7e73-4402-baa1-a9127ec2bd56 req-5c318a89-dd98-43e8-a76d-8735dbe6547c tempest-ServersNegativeTestMultiTenantJSON-993199092 tempest-ServersNegativeTestMultiTenantJSON-993199092-project-member] Enqueued Resource ID: e285eaec-686f-4ae5-a9aa-59215e24189f with Priority: HIGHEST for action security_group_members [ 703.866277] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e285eaec-686f-4ae5-a9aa-59215e24189f with Priority: HIGHEST for action security_group_members [ 703.867031] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e285eaec-686f-4ae5-a9aa-59215e24189f taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.867423] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.867595] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.867876] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.868150] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.869102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.869102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.869102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.869102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.869102] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e285eaec-686f-4ae5-a9aa-59215e24189f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.989872] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14427d59-3459-4ddd-9c42-78877a31172d in Status: SUCCESS [ 703.990237] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.992911] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('752cf951-e22b-4bfc-b89a-6766804d295f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.373706] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.374108] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.374108] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.374265] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.374355] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.374551] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.374665] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.374765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.374879] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.374952] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.375050] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e285eaec-686f-4ae5-a9aa-59215e24189f is going to be updated. [ 704.409567] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.409779] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.409779] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.410079] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.410316] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.422237] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e285eaec-686f-4ae5-a9aa-59215e24189f in Status: IN_PROGRESS for 2s [ 704.422946] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: SUCCESS [ 704.423156] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.423741] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.423741] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.423741] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.423888] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.424021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.424171] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.424362] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.424436] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.496813] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 752cf951-e22b-4bfc-b89a-6766804d295f: rpc.has_security_group_logging(os_id): False [ 704.518702] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.518929] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.518986] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.519252] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.519337] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.519587] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.519817] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.519817] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.519908] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.519994] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.520203] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 752cf951-e22b-4bfc-b89a-6766804d295f is going to be created. [ 704.586842] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.587118] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.587118] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.588598] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.588598] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.609326] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 752cf951-e22b-4bfc-b89a-6766804d295f in Status: IN_PROGRESS for 2s [ 704.926991] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.429522] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.525551] env[65783]: INFO networking_nsxv3.common.synchronization [req-f6e63d72-4b04-4e4e-bd39-47f78ee181c1 req-5438b125-d139-4d07-807d-5ebf7a164abe tempest-ImagesTestJSON-433702528 tempest-ImagesTestJSON-433702528-project-member] Enqueued Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 705.525551] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 705.526823] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.527175] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.527339] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.527740] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.528139] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.528473] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.530590] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.530590] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.530590] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.530590] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.735907] env[65783]: INFO networking_nsxv3.common.synchronization [req-16b3c969-fc69-4182-bb9e-f98fb030d0c9 req-ec61b367-7e9a-4e0d-9acf-374609cd00bb tempest-SecurityGroupRulesTestJSON-1774018064 tempest-SecurityGroupRulesTestJSON-1774018064-project-member] Enqueued Resource ID: faa3a6dd-5af8-4d2c-b4c3-a23b42ea6837 with Priority: HIGHEST for action security_group_rules [ 705.736449] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faa3a6dd-5af8-4d2c-b4c3-a23b42ea6837 with Priority: HIGHEST for action security_group_rules [ 705.736779] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-faa3a6dd-5af8-4d2c-b4c3-a23b42ea6837 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.736861] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-faa3a6dd-5af8-4d2c-b4c3-a23b42ea6837" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.736861] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-faa3a6dd-5af8-4d2c-b4c3-a23b42ea6837" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.737240] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-faa3a6dd-5af8-4d2c-b4c3-a23b42ea6837" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.737268] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('faa3a6dd-5af8-4d2c-b4c3-a23b42ea6837',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.934263] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.934263] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.934492] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.934540] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.935321] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.935321] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca99b1a6-3702-4011-942b-06036fda2165 is going to be updated. [ 705.967119] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.967310] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.967383] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.967731] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.967851] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.979994] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: IN_PROGRESS for 2s [ 706.034018] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.034541] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.034541] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.034776] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.034943] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.035268] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.035441] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.035551] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.035805] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.035938] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.036120] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd942bf-b305-4707-8084-1ac6b135c741 is going to be updated. [ 706.067948] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.068219] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.068350] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.068675] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.068899] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.079877] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: IN_PROGRESS for 2s [ 706.265035] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.265270] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.265349] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.265570] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.265669] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.265766] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: faa3a6dd-5af8-4d2c-b4c3-a23b42ea6837 already deleted. [ 706.265845] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-faa3a6dd-5af8-4d2c-b4c3-a23b42ea6837" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.301322] env[65783]: INFO networking_nsxv3.common.synchronization [req-0baebee7-be22-4ef9-b61a-282d7241c8fa req-3d1b78f3-44cf-4b40-bff8-cedb259ebcf6 tempest-SecurityGroupRulesTestJSON-1774018064 tempest-SecurityGroupRulesTestJSON-1774018064-project-member] Enqueued Resource ID: faa3a6dd-5af8-4d2c-b4c3-a23b42ea6837 with Priority: HIGHEST for action security_group_rules [ 706.302099] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faa3a6dd-5af8-4d2c-b4c3-a23b42ea6837 with Priority: HIGHEST for action security_group_rules [ 706.302437] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-faa3a6dd-5af8-4d2c-b4c3-a23b42ea6837 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.302593] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-faa3a6dd-5af8-4d2c-b4c3-a23b42ea6837" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.302661] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-faa3a6dd-5af8-4d2c-b4c3-a23b42ea6837" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.303471] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-faa3a6dd-5af8-4d2c-b4c3-a23b42ea6837" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.303471] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('faa3a6dd-5af8-4d2c-b4c3-a23b42ea6837',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.432189] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e285eaec-686f-4ae5-a9aa-59215e24189f in Status: SUCCESS [ 706.432528] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e285eaec-686f-4ae5-a9aa-59215e24189f deletion is rescheduled due to dependency. [ 706.432528] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.626931] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 752cf951-e22b-4bfc-b89a-6766804d295f in Status: SUCCESS [ 706.626931] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.832042] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.832042] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.832042] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.832042] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.832952] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.832952] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: faa3a6dd-5af8-4d2c-b4c3-a23b42ea6837 already deleted. [ 706.832952] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-faa3a6dd-5af8-4d2c-b4c3-a23b42ea6837" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.152165] env[65783]: INFO networking_nsxv3.common.synchronization [req-d1408557-1553-45dc-b892-a570666b27b8 req-61d81107-a828-4eec-a7c3-a60a6aa0ba7d tempest-SecurityGroupRulesTestJSON-1774018064 tempest-SecurityGroupRulesTestJSON-1774018064-project-member] Enqueued Resource ID: faa3a6dd-5af8-4d2c-b4c3-a23b42ea6837 with Priority: HIGHEST for action security_group_rules [ 707.152751] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faa3a6dd-5af8-4d2c-b4c3-a23b42ea6837 with Priority: HIGHEST for action security_group_rules [ 707.153310] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-faa3a6dd-5af8-4d2c-b4c3-a23b42ea6837 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.153439] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-faa3a6dd-5af8-4d2c-b4c3-a23b42ea6837" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.153527] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-faa3a6dd-5af8-4d2c-b4c3-a23b42ea6837" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.153710] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-faa3a6dd-5af8-4d2c-b4c3-a23b42ea6837" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.153790] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('faa3a6dd-5af8-4d2c-b4c3-a23b42ea6837',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.686358] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.690244] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.690393] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.690840] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.690954] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.691081] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: faa3a6dd-5af8-4d2c-b4c3-a23b42ea6837 already deleted. [ 707.691143] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-faa3a6dd-5af8-4d2c-b4c3-a23b42ea6837" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.991461] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: SUCCESS [ 707.991664] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.991877] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.992156] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.992595] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.992595] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.996352] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.996352] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.996352] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.996352] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.996352] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.094561] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: SUCCESS [ 708.094685] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd942bf-b305-4707-8084-1ac6b135c741 deletion is rescheduled due to dependency. [ 708.094836] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.499962] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca99b1a6-3702-4011-942b-06036fda2165 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.500214] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.500323] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.500706] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.500955] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.501119] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.501215] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.501439] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.501573] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.501706] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.501910] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca99b1a6-3702-4011-942b-06036fda2165 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.502062] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.502154] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.502354] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.502768] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.502768] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.502768] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.503016] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.503275] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.503443] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.503612] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.007402] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca99b1a6-3702-4011-942b-06036fda2165: rpc.has_security_group_logging(os_id): False [ 709.031178] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.031373] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.031414] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.033026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.033026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.033026] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.033026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.033026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.033026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.033026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.033026] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.033026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.033705] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.033841] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.033986] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.036818] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.036818] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.036818] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.036818] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.038214] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.038214] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca99b1a6-3702-4011-942b-06036fda2165 is going to be updated. [ 709.115538] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.115538] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.115538] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.115538] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.115538] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.132113] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: IN_PROGRESS for 2s [ 709.620168] env[65783]: INFO networking_nsxv3.common.synchronization [None req-9b84675f-b2d8-4ed4-8b62-e1e9f77283f2 None None] Enqueued Resource ID: 0f7c1902-c7ea-4f22-8a88-2f2697dc75db with Priority: HIGHEST for action port [ 709.621731] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f7c1902-c7ea-4f22-8a88-2f2697dc75db with Priority: HIGHEST for action port [ 709.621960] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f7c1902-c7ea-4f22-8a88-2f2697dc75db taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.622157] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f7c1902-c7ea-4f22-8a88-2f2697dc75db" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.622231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f7c1902-c7ea-4f22-8a88-2f2697dc75db" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.622498] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f7c1902-c7ea-4f22-8a88-2f2697dc75db" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.622582] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f7c1902-c7ea-4f22-8a88-2f2697dc75db',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.127716] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f7c1902-c7ea-4f22-8a88-2f2697dc75db [ 710.128065] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.128142] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.128177] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.128392] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.128479] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.128570] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f7c1902-c7ea-4f22-8a88-2f2697dc75db already deleted. [ 710.128649] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f7c1902-c7ea-4f22-8a88-2f2697dc75db" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.152942] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: SUCCESS [ 711.153386] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.082440] env[65783]: INFO networking_nsxv3.common.synchronization [None req-0e9b43a9-7ca7-4a6f-9af5-aa208b4a16d8 None None] Enqueued Resource ID: 30027899-e6a5-4f0b-bb53-ba32706aeb5b with Priority: HIGHEST for action port [ 712.082440] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30027899-e6a5-4f0b-bb53-ba32706aeb5b with Priority: HIGHEST for action port [ 712.082440] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-30027899-e6a5-4f0b-bb53-ba32706aeb5b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.082440] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30027899-e6a5-4f0b-bb53-ba32706aeb5b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.082440] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30027899-e6a5-4f0b-bb53-ba32706aeb5b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.082440] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30027899-e6a5-4f0b-bb53-ba32706aeb5b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.082440] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30027899-e6a5-4f0b-bb53-ba32706aeb5b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.584705] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30027899-e6a5-4f0b-bb53-ba32706aeb5b [ 712.585300] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.586692] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.586692] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.586862] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.587941] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.587941] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30027899-e6a5-4f0b-bb53-ba32706aeb5b already deleted. [ 712.587941] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30027899-e6a5-4f0b-bb53-ba32706aeb5b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.865693] env[65783]: INFO networking_nsxv3.common.synchronization [req-17301729-9926-468b-9683-f01f86b11917 req-6d014ec0-5255-44e6-b825-04b7a5cb421e tempest-ServersAdminNegativeTestJSON-2089691366 tempest-ServersAdminNegativeTestJSON-2089691366-project-member] Enqueued Resource ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c with Priority: HIGHEST for action security_group_members [ 714.866092] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c with Priority: HIGHEST for action security_group_members [ 714.866944] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5516de4-7ca8-423d-ae28-4654dc2ae29c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.867146] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.867827] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.867827] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.867827] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.867827] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.867827] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.868270] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.868270] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.868270] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5516de4-7ca8-423d-ae28-4654dc2ae29c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.377060] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.377060] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.377060] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.377628] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.377628] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.377628] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.377628] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.377628] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.377873] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.377873] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.377967] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c already deleted. [ 715.377967] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.658204] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-251 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.658916] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.658916] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.659100] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.660305] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.660474] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.660587] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.660852] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.661463] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.661463] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 715.661463] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 715.661725] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 715.663211] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 715.663341] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 715.663455] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 715.663580] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 715.686152] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 715.686304] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 715.686436] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 715.686599] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.686913] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-619462da-ce8b-4b5f-9459-5229925adbb6 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.687394] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-619462da-ce8b-4b5f-9459-5229925adbb6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.687394] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-619462da-ce8b-4b5f-9459-5229925adbb6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.687565] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-619462da-ce8b-4b5f-9459-5229925adbb6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.687667] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('619462da-ce8b-4b5f-9459-5229925adbb6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.190097] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.190750] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.190750] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.190750] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.190919] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.191080] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 619462da-ce8b-4b5f-9459-5229925adbb6 not found, creating... [ 716.191375] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.191532] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.191644] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.191855] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.191983] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.192282] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.192447] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.192557] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.192759] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.193563] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.193772] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 619462da-ce8b-4b5f-9459-5229925adbb6 is going to be created. [ 716.215960] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.215960] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.216290] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.216440] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.217093] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.217450] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-619462da-ce8b-4b5f-9459-5229925adbb6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.331163] env[65783]: INFO networking_nsxv3.common.synchronization [None req-5673f3b4-ce1f-41a7-99d6-46c4383e8047 None None] Enqueued Resource ID: 8b916f0c-54e2-4685-94ba-97d9a5bce8b7 with Priority: HIGHEST for action port [ 716.331807] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b916f0c-54e2-4685-94ba-97d9a5bce8b7 with Priority: HIGHEST for action port [ 716.332149] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b916f0c-54e2-4685-94ba-97d9a5bce8b7 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.332275] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b916f0c-54e2-4685-94ba-97d9a5bce8b7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.332346] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b916f0c-54e2-4685-94ba-97d9a5bce8b7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.332683] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b916f0c-54e2-4685-94ba-97d9a5bce8b7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.332790] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b916f0c-54e2-4685-94ba-97d9a5bce8b7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.835899] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8b916f0c-54e2-4685-94ba-97d9a5bce8b7 [ 716.836233] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.837152] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.837152] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.837152] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.837152] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.837152] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8b916f0c-54e2-4685-94ba-97d9a5bce8b7 already deleted. [ 716.837152] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b916f0c-54e2-4685-94ba-97d9a5bce8b7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.984861] env[65783]: INFO networking_nsxv3.common.synchronization [req-17301729-9926-468b-9683-f01f86b11917 req-a6e321e5-487a-4bbe-b634-f9a3c1e5e419 service nova] Enqueued Resource ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c with Priority: HIGHEST for action security_group_rules [ 716.984861] env[65783]: INFO networking_nsxv3.common.synchronization [req-17301729-9926-468b-9683-f01f86b11917 req-a6e321e5-487a-4bbe-b634-f9a3c1e5e419 service nova] Enqueued Resource ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c with Priority: HIGHEST for action security_group_members [ 716.985363] env[65783]: INFO networking_nsxv3.common.synchronization [req-17301729-9926-468b-9683-f01f86b11917 req-a6e321e5-487a-4bbe-b634-f9a3c1e5e419 service nova] Enqueued Resource ID: 619462da-ce8b-4b5f-9459-5229925adbb6 with Priority: HIGHEST for action port [ 716.985363] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c with Priority: HIGHEST for action security_group_rules [ 716.985429] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c with Priority: HIGHEST for action security_group_members [ 716.985496] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 619462da-ce8b-4b5f-9459-5229925adbb6 with Priority: HIGHEST for action port [ 716.986395] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5516de4-7ca8-423d-ae28-4654dc2ae29c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.986571] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.986665] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.986944] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.987098] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5516de4-7ca8-423d-ae28-4654dc2ae29c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.990855] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5516de4-7ca8-423d-ae28-4654dc2ae29c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.990855] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.990855] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.990855] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.990855] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.990855] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.990855] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.990855] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.990855] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.990855] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5516de4-7ca8-423d-ae28-4654dc2ae29c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.992268] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-619462da-ce8b-4b5f-9459-5229925adbb6 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.992268] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-619462da-ce8b-4b5f-9459-5229925adbb6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.992268] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-619462da-ce8b-4b5f-9459-5229925adbb6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.992611] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-619462da-ce8b-4b5f-9459-5229925adbb6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.992611] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('619462da-ce8b-4b5f-9459-5229925adbb6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.491223] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5516de4-7ca8-423d-ae28-4654dc2ae29c taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.491703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.495388] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5516de4-7ca8-423d-ae28-4654dc2ae29c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.496615] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 619462da-ce8b-4b5f-9459-5229925adbb6 with status ACTIVE [ 717.496876] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.497116] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.497236] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.497537] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.497691] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.497963] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.498201] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.498310] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.498593] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.498733] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.499171] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.499171] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.499171] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.499562] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.499562] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.499562] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 619462da-ce8b-4b5f-9459-5229925adbb6 is going to be updated. [ 717.529026] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.529026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.529026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.529026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.529026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.529026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-619462da-ce8b-4b5f-9459-5229925adbb6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.804145] env[65783]: INFO networking_nsxv3.common.synchronization [req-0d5da777-e4ad-4718-bdd2-d832950e9dcd req-0bb67079-1a14-4d8b-a4fc-a2b343aa8b22 tempest-ServerMetadataTestJSON-2105857083 tempest-ServerMetadataTestJSON-2105857083-project-member] Enqueued Resource ID: 7998a549-f70e-4b58-992e-5c5ab6652711 with Priority: HIGHEST for action security_group_members [ 717.804980] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7998a549-f70e-4b58-992e-5c5ab6652711 with Priority: HIGHEST for action security_group_members [ 717.805809] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-7998a549-f70e-4b58-992e-5c5ab6652711 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.806106] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7998a549-f70e-4b58-992e-5c5ab6652711" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.806314] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7998a549-f70e-4b58-992e-5c5ab6652711" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.808017] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7998a549-f70e-4b58-992e-5c5ab6652711" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.808017] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.808017] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.808017] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.808017] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.808017] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.808017] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7998a549-f70e-4b58-992e-5c5ab6652711',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.003185] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5516de4-7ca8-423d-ae28-4654dc2ae29c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.256143] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-865 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.256143] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-865" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.256333] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-865" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.256913] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-865" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.256913] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.257085] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.257613] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.257944] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.258183] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.258456] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 718.258675] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 718.259015] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 718.259196] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 718.259351] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 718.259504] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 718.259687] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 718.279827] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 718.280011] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 718.280156] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 718.280345] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-865" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.280706] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-97cfb515-1e9e-4a23-bef7-86b855e9ab3f taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.280911] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-97cfb515-1e9e-4a23-bef7-86b855e9ab3f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.281043] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-97cfb515-1e9e-4a23-bef7-86b855e9ab3f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.281370] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-97cfb515-1e9e-4a23-bef7-86b855e9ab3f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.281496] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97cfb515-1e9e-4a23-bef7-86b855e9ab3f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.310298] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.310522] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.310522] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.310801] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.310950] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.311144] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.311251] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.311318] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.311460] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.311644] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.311644] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7998a549-f70e-4b58-992e-5c5ab6652711 already deleted. [ 718.311782] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7998a549-f70e-4b58-992e-5c5ab6652711" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.506304] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.506304] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.506304] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.506304] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.506304] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.506304] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c is going to be created. [ 718.549208] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.549208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.549208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.549208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.549208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.561122] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c in Status: UNINITIALIZED for 2s [ 718.784227] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.785070] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.785231] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.785517] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.785698] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.785874] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 97cfb515-1e9e-4a23-bef7-86b855e9ab3f not found, creating... [ 718.786186] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.786346] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.786459] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.786720] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.786866] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.787193] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.787356] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.787454] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.787669] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.787807] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.787958] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 97cfb515-1e9e-4a23-bef7-86b855e9ab3f is going to be created. [ 718.810942] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.811206] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.811325] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.811608] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.811858] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.812360] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-97cfb515-1e9e-4a23-bef7-86b855e9ab3f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.083823] env[65783]: INFO networking_nsxv3.common.synchronization [req-56f0eb6e-6722-4551-9519-31d210f6d0c1 req-3fe8da02-e592-483d-9424-35bcdc0042c0 tempest-FloatingIPsAssociationTestJSON-1491106384 tempest-FloatingIPsAssociationTestJSON-1491106384-project-member] Enqueued Resource ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e with Priority: HIGHEST for action security_group_members [ 719.084773] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e with Priority: HIGHEST for action security_group_members [ 719.084879] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.084971] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.084971] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.085196] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.085356] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.085598] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.085598] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.085673] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.085762] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.085859] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d536ed15-4c4c-44ea-b9bd-1b0e46123d7e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.230429] env[65783]: INFO networking_nsxv3.common.synchronization [None req-3c863a2a-5dd1-418f-a71c-40fd2780a0da None None] Enqueued Resource ID: bd8a9a3a-1ef8-4942-96ef-16ffe0e53094 with Priority: HIGHEST for action port [ 719.231218] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd8a9a3a-1ef8-4942-96ef-16ffe0e53094 with Priority: HIGHEST for action port [ 719.231647] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd8a9a3a-1ef8-4942-96ef-16ffe0e53094 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.231827] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd8a9a3a-1ef8-4942-96ef-16ffe0e53094" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.231941] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd8a9a3a-1ef8-4942-96ef-16ffe0e53094" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.232233] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd8a9a3a-1ef8-4942-96ef-16ffe0e53094" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.232422] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd8a9a3a-1ef8-4942-96ef-16ffe0e53094',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.521171] env[65783]: INFO networking_nsxv3.common.synchronization [req-0d5da777-e4ad-4718-bdd2-d832950e9dcd req-f6d63522-c247-4b7b-b0ba-987b40d0f789 service nova] Enqueued Resource ID: 7998a549-f70e-4b58-992e-5c5ab6652711 with Priority: HIGHEST for action security_group_rules [ 719.522293] env[65783]: INFO networking_nsxv3.common.synchronization [req-0d5da777-e4ad-4718-bdd2-d832950e9dcd req-f6d63522-c247-4b7b-b0ba-987b40d0f789 service nova] Enqueued Resource ID: 7998a549-f70e-4b58-992e-5c5ab6652711 with Priority: HIGHEST for action security_group_members [ 719.522293] env[65783]: INFO networking_nsxv3.common.synchronization [req-0d5da777-e4ad-4718-bdd2-d832950e9dcd req-f6d63522-c247-4b7b-b0ba-987b40d0f789 service nova] Enqueued Resource ID: 97cfb515-1e9e-4a23-bef7-86b855e9ab3f with Priority: HIGHEST for action port [ 719.523235] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7998a549-f70e-4b58-992e-5c5ab6652711 with Priority: HIGHEST for action security_group_rules [ 719.523235] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7998a549-f70e-4b58-992e-5c5ab6652711 with Priority: HIGHEST for action security_group_members [ 719.523304] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97cfb515-1e9e-4a23-bef7-86b855e9ab3f with Priority: HIGHEST for action port [ 719.523596] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7998a549-f70e-4b58-992e-5c5ab6652711 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.523728] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7998a549-f70e-4b58-992e-5c5ab6652711" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.523794] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7998a549-f70e-4b58-992e-5c5ab6652711" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.527585] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7998a549-f70e-4b58-992e-5c5ab6652711" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.527585] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7998a549-f70e-4b58-992e-5c5ab6652711',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.528862] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-7998a549-f70e-4b58-992e-5c5ab6652711 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.529086] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7998a549-f70e-4b58-992e-5c5ab6652711" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.529086] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7998a549-f70e-4b58-992e-5c5ab6652711" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.529260] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7998a549-f70e-4b58-992e-5c5ab6652711" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.529459] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.529516] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.529559] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.529737] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.529812] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.529942] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7998a549-f70e-4b58-992e-5c5ab6652711',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.531042] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-97cfb515-1e9e-4a23-bef7-86b855e9ab3f taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.531188] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97cfb515-1e9e-4a23-bef7-86b855e9ab3f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.531286] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97cfb515-1e9e-4a23-bef7-86b855e9ab3f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.531484] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97cfb515-1e9e-4a23-bef7-86b855e9ab3f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.531585] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97cfb515-1e9e-4a23-bef7-86b855e9ab3f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.589332] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d536ed15-4c4c-44ea-b9bd-1b0e46123d7e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.734489] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bd8a9a3a-1ef8-4942-96ef-16ffe0e53094 [ 719.734489] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.734489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.734489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.735768] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.735768] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.735768] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bd8a9a3a-1ef8-4942-96ef-16ffe0e53094 already deleted. [ 719.735768] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd8a9a3a-1ef8-4942-96ef-16ffe0e53094" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.887971] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-307 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.888396] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-307" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.888591] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-307" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.888914] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-307" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.889353] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.889584] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.889738] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.889991] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.890172] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.890400] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 719.890543] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 719.890729] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 719.890885] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 719.891058] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 719.891191] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 719.891347] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 719.911164] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 719.911334] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 719.911467] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 719.911624] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-307" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.911968] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-325d6907-21b3-4ed1-9291-659b2ee9c13d taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.912165] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-325d6907-21b3-4ed1-9291-659b2ee9c13d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.912279] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-325d6907-21b3-4ed1-9291-659b2ee9c13d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.912581] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-325d6907-21b3-4ed1-9291-659b2ee9c13d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.912713] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('325d6907-21b3-4ed1-9291-659b2ee9c13d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.038174] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-7998a549-f70e-4b58-992e-5c5ab6652711 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.038174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7998a549-f70e-4b58-992e-5c5ab6652711" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.038174] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7998a549-f70e-4b58-992e-5c5ab6652711',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.038174] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 97cfb515-1e9e-4a23-bef7-86b855e9ab3f with status ACTIVE [ 720.038174] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.038174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.038174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.038174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.038174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.038174] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.038174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.038174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.038174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.038174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.038644] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.039801] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.040036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.040303] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.041556] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.041556] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 97cfb515-1e9e-4a23-bef7-86b855e9ab3f is going to be updated. [ 720.066726] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.066726] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.066726] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.066726] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.066726] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.066726] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97cfb515-1e9e-4a23-bef7-86b855e9ab3f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.091922] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d536ed15-4c4c-44ea-b9bd-1b0e46123d7e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.415534] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.416041] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.416995] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.416995] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.416995] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.416995] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 325d6907-21b3-4ed1-9291-659b2ee9c13d not found, creating... [ 720.417223] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.417289] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.417446] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.417620] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.417769] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.418068] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.418223] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.418333] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.418537] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.418671] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.418817] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 325d6907-21b3-4ed1-9291-659b2ee9c13d is going to be created. [ 720.441988] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.442200] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.442279] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.442549] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.442772] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.442991] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-325d6907-21b3-4ed1-9291-659b2ee9c13d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.543147] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7998a549-f70e-4b58-992e-5c5ab6652711',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.571131] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c in Status: SUCCESS [ 720.571344] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.571497] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.571722] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.572552] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.572552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.572552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.572552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.572552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.572552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.572552] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5516de4-7ca8-423d-ae28-4654dc2ae29c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.598388] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.598542] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.598611] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.598859] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.598953] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.599062] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e is going to be updated. [ 720.636478] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.636629] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.636701] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.636907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.638131] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.646925] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e in Status: IN_PROGRESS for 2s [ 721.048999] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.048999] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.048999] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.048999] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.048999] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.049301] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7998a549-f70e-4b58-992e-5c5ab6652711 is going to be created. [ 721.073574] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.073778] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.073778] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.074137] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.074137] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.075302] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5516de4-7ca8-423d-ae28-4654dc2ae29c taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.075463] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.075463] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.075632] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.076364] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.076364] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.076364] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.076725] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.076725] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.076725] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.076835] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5516de4-7ca8-423d-ae28-4654dc2ae29c taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.076877] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.076926] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.077098] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.077236] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.077399] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.077399] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.077542] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.077615] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.077697] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.077789] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5516de4-7ca8-423d-ae28-4654dc2ae29c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.088686] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7998a549-f70e-4b58-992e-5c5ab6652711 in Status: UNINITIALIZED for 2s [ 721.173552] env[65783]: INFO networking_nsxv3.common.synchronization [req-56f0eb6e-6722-4551-9519-31d210f6d0c1 req-9a7feea2-e4d4-4663-858c-d2c96d65f3d9 service nova] Enqueued Resource ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e with Priority: HIGHEST for action security_group_rules [ 721.174069] env[65783]: INFO networking_nsxv3.common.synchronization [req-56f0eb6e-6722-4551-9519-31d210f6d0c1 req-9a7feea2-e4d4-4663-858c-d2c96d65f3d9 service nova] Enqueued Resource ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e with Priority: HIGHEST for action security_group_members [ 721.174069] env[65783]: INFO networking_nsxv3.common.synchronization [req-56f0eb6e-6722-4551-9519-31d210f6d0c1 req-9a7feea2-e4d4-4663-858c-d2c96d65f3d9 service nova] Enqueued Resource ID: 325d6907-21b3-4ed1-9291-659b2ee9c13d with Priority: HIGHEST for action port [ 721.174414] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e with Priority: HIGHEST for action security_group_rules [ 721.174569] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e with Priority: HIGHEST for action security_group_members [ 721.174666] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 325d6907-21b3-4ed1-9291-659b2ee9c13d with Priority: HIGHEST for action port [ 721.174945] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.175249] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.175328] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.175556] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.175658] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d536ed15-4c4c-44ea-b9bd-1b0e46123d7e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.177443] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.177443] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.177571] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-325d6907-21b3-4ed1-9291-659b2ee9c13d taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.177571] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-325d6907-21b3-4ed1-9291-659b2ee9c13d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.177658] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-325d6907-21b3-4ed1-9291-659b2ee9c13d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.177803] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-325d6907-21b3-4ed1-9291-659b2ee9c13d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.177868] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('325d6907-21b3-4ed1-9291-659b2ee9c13d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.581742] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5516de4-7ca8-423d-ae28-4654dc2ae29c: rpc.has_security_group_logging(os_id): False [ 721.600012] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.600180] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.600251] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.601032] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.601032] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.601032] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.601032] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.601032] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.601263] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.601263] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.602278] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.602278] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.602278] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.602278] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.602278] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.602556] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.602556] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.602556] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.602677] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.602947] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.602947] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c is going to be created. [ 721.666316] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.666606] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.666694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.666930] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.667214] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.678230] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.678387] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.680472] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c in Status: IN_PROGRESS for 2s [ 721.680816] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 325d6907-21b3-4ed1-9291-659b2ee9c13d with status ACTIVE [ 721.681172] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.681355] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.681482] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.681732] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.681852] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.682104] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.682222] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.682292] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.682539] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.682685] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.682984] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.683160] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.683264] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.683522] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.683658] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.683797] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 325d6907-21b3-4ed1-9291-659b2ee9c13d is going to be updated. [ 721.707555] env[65783]: INFO networking_nsxv3.common.synchronization [req-3e8612b8-3e63-4dd2-be2e-3e8fe3ed59d0 req-2faad515-60a4-4417-a8bf-dd9711b62d3f tempest-ServersTestBootFromVolume-1696516378 tempest-ServersTestBootFromVolume-1696516378-project-member] Enqueued Resource ID: 3654b92f-abc1-46ca-b6d3-5854c70c886e with Priority: HIGHEST for action security_group_members [ 721.708229] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3654b92f-abc1-46ca-b6d3-5854c70c886e with Priority: HIGHEST for action security_group_members [ 721.708607] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3654b92f-abc1-46ca-b6d3-5854c70c886e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.710774] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.710774] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.710965] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.711168] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.711356] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.711463] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.711761] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.712080] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.712080] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3654b92f-abc1-46ca-b6d3-5854c70c886e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.718220] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.718457] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.718586] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.719072] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.721346] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.721346] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-325d6907-21b3-4ed1-9291-659b2ee9c13d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.214770] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.214925] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.215061] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.215315] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.215412] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.215620] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.215726] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.215781] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.215934] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.216018] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.216114] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3654b92f-abc1-46ca-b6d3-5854c70c886e already deleted. [ 722.216197] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.235774] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-477 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.235969] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-477" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.236104] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-477" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.236433] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-477" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.236717] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.236889] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.237009] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.240357] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.240552] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.240866] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 722.240986] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 722.241113] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 722.241217] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 722.241322] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 722.241421] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 722.241630] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 722.263744] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 722.263911] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 722.264054] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 722.264224] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-477" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.264818] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-2117f600-f365-489d-9475-bf0afdc8f512 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.264818] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-2117f600-f365-489d-9475-bf0afdc8f512" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.264818] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-2117f600-f365-489d-9475-bf0afdc8f512" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.265126] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-2117f600-f365-489d-9475-bf0afdc8f512" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.265262] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2117f600-f365-489d-9475-bf0afdc8f512',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.657159] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e in Status: SUCCESS [ 722.657540] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.657621] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.657858] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.658083] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.658211] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.658289] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.658454] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.658551] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.658676] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d536ed15-4c4c-44ea-b9bd-1b0e46123d7e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.768292] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.768292] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.768292] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.768588] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.768697] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.768853] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 2117f600-f365-489d-9475-bf0afdc8f512 not found, creating... [ 722.769127] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.769283] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.769394] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.769617] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.769742] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.770019] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.770173] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.770561] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.770561] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.770737] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.770737] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 2117f600-f365-489d-9475-bf0afdc8f512 is going to be created. [ 722.800055] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.800323] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.800442] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.800734] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.800970] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.801207] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-2117f600-f365-489d-9475-bf0afdc8f512" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.102486] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7998a549-f70e-4b58-992e-5c5ab6652711 in Status: SUCCESS [ 723.102726] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7998a549-f70e-4b58-992e-5c5ab6652711" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.102909] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7998a549-f70e-4b58-992e-5c5ab6652711" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.103189] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7998a549-f70e-4b58-992e-5c5ab6652711" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.103637] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.103637] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.103637] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.103803] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.103850] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.103920] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7998a549-f70e-4b58-992e-5c5ab6652711" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.104033] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7998a549-f70e-4b58-992e-5c5ab6652711',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.161925] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d536ed15-4c4c-44ea-b9bd-1b0e46123d7e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.547175] env[65783]: INFO networking_nsxv3.common.synchronization [req-3e8612b8-3e63-4dd2-be2e-3e8fe3ed59d0 req-ed8ba29e-b567-476d-8580-1867eaae6702 service nova] Enqueued Resource ID: 3654b92f-abc1-46ca-b6d3-5854c70c886e with Priority: HIGHEST for action security_group_rules [ 723.547175] env[65783]: INFO networking_nsxv3.common.synchronization [req-3e8612b8-3e63-4dd2-be2e-3e8fe3ed59d0 req-ed8ba29e-b567-476d-8580-1867eaae6702 service nova] Enqueued Resource ID: 3654b92f-abc1-46ca-b6d3-5854c70c886e with Priority: HIGHEST for action security_group_members [ 723.547175] env[65783]: INFO networking_nsxv3.common.synchronization [req-3e8612b8-3e63-4dd2-be2e-3e8fe3ed59d0 req-ed8ba29e-b567-476d-8580-1867eaae6702 service nova] Enqueued Resource ID: 2117f600-f365-489d-9475-bf0afdc8f512 with Priority: HIGHEST for action port [ 723.548663] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3654b92f-abc1-46ca-b6d3-5854c70c886e with Priority: HIGHEST for action security_group_rules [ 723.548969] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3654b92f-abc1-46ca-b6d3-5854c70c886e with Priority: HIGHEST for action security_group_members [ 723.549212] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2117f600-f365-489d-9475-bf0afdc8f512 with Priority: HIGHEST for action port [ 723.549826] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3654b92f-abc1-46ca-b6d3-5854c70c886e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.550123] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.550431] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.550986] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.551174] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3654b92f-abc1-46ca-b6d3-5854c70c886e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.553709] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3654b92f-abc1-46ca-b6d3-5854c70c886e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.554019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.556172] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.556172] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.556172] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.556172] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.556172] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.556172] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.556471] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.556733] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3654b92f-abc1-46ca-b6d3-5854c70c886e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.559085] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-2117f600-f365-489d-9475-bf0afdc8f512 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.559451] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2117f600-f365-489d-9475-bf0afdc8f512" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.559713] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2117f600-f365-489d-9475-bf0afdc8f512" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.560032] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2117f600-f365-489d-9475-bf0afdc8f512" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.560760] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2117f600-f365-489d-9475-bf0afdc8f512',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.607793] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-7998a549-f70e-4b58-992e-5c5ab6652711 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.607793] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7998a549-f70e-4b58-992e-5c5ab6652711" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.607793] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7998a549-f70e-4b58-992e-5c5ab6652711" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.607793] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7998a549-f70e-4b58-992e-5c5ab6652711" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.607793] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.607793] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.607793] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.607793] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.607793] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.607793] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7998a549-f70e-4b58-992e-5c5ab6652711" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.608181] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-7998a549-f70e-4b58-992e-5c5ab6652711 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.608181] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7998a549-f70e-4b58-992e-5c5ab6652711" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.608181] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7998a549-f70e-4b58-992e-5c5ab6652711" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.608737] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7998a549-f70e-4b58-992e-5c5ab6652711" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.608737] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.608737] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.608737] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.608737] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.608926] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.608926] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7998a549-f70e-4b58-992e-5c5ab6652711" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.609107] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7998a549-f70e-4b58-992e-5c5ab6652711',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.664667] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d536ed15-4c4c-44ea-b9bd-1b0e46123d7e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.694550] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c in Status: SUCCESS [ 723.694859] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.054103] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3654b92f-abc1-46ca-b6d3-5854c70c886e taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.054221] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.059558] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3654b92f-abc1-46ca-b6d3-5854c70c886e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.063873] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2117f600-f365-489d-9475-bf0afdc8f512 with status ACTIVE [ 724.063873] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.063873] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.063873] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.063873] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.063873] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.064592] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.064592] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.064592] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.064592] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.064592] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.064592] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.066166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.066166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.066166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.066166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.066166] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2117f600-f365-489d-9475-bf0afdc8f512 is going to be updated. [ 724.086843] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.086979] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.087093] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.087281] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.087408] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.087627] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2117f600-f365-489d-9475-bf0afdc8f512" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.111343] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7998a549-f70e-4b58-992e-5c5ab6652711: rpc.has_security_group_logging(os_id): False [ 724.133148] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.133148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.133148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.133148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.133148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.133148] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.133148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.133148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.133148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.133148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.133148] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.133148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.133148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.133633] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.133633] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.133633] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.133633] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.133633] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.134934] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.135051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.135142] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7998a549-f70e-4b58-992e-5c5ab6652711 is going to be created. [ 724.169402] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.169402] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.169402] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.169402] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.169402] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.169402] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e is going to be updated. [ 724.224180] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.224374] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.224374] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.225687] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.225687] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.230913] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.231133] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.231133] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.231318] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.231493] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.236815] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e in Status: IN_PROGRESS for 2s [ 724.249960] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7998a549-f70e-4b58-992e-5c5ab6652711 in Status: IN_PROGRESS for 2s [ 724.562830] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3654b92f-abc1-46ca-b6d3-5854c70c886e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.068041] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.068041] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.068041] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.068041] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.068041] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.068535] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3654b92f-abc1-46ca-b6d3-5854c70c886e is going to be created. [ 725.099896] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.100572] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.100572] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.100572] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.100572] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.114056] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3654b92f-abc1-46ca-b6d3-5854c70c886e in Status: UNINITIALIZED for 2s [ 726.248918] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e in Status: SUCCESS [ 726.250407] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.252187] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.253615] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.253615] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.253762] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.253762] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.254032] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.254190] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.254345] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.254489] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d536ed15-4c4c-44ea-b9bd-1b0e46123d7e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.272778] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7998a549-f70e-4b58-992e-5c5ab6652711 in Status: SUCCESS [ 726.273215] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7998a549-f70e-4b58-992e-5c5ab6652711" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.758164] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.758391] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.758490] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.758855] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.759185] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.759185] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.759185] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.759412] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.759412] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.763010] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.763010] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.763010] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.763010] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.763010] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.763010] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.763010] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.763010] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.763010] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.763010] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.763010] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.763010] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d536ed15-4c4c-44ea-b9bd-1b0e46123d7e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.125832] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3654b92f-abc1-46ca-b6d3-5854c70c886e in Status: SUCCESS [ 727.126118] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.127469] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.127702] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.127901] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.128031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.128089] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.128238] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.128319] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.128402] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.128513] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3654b92f-abc1-46ca-b6d3-5854c70c886e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.264151] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d536ed15-4c4c-44ea-b9bd-1b0e46123d7e: rpc.has_security_group_logging(os_id): False [ 727.286556] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.286713] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.286758] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.286987] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.287091] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.287339] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.287395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.287461] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.287616] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.287693] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.288170] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.288416] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.288495] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.288761] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.288968] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.289210] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.289492] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.289492] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.289492] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.289615] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.289643] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e is going to be updated. [ 727.362599] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.362776] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.362826] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.363367] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.363367] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.380472] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e in Status: IN_PROGRESS for 2s [ 727.634303] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3654b92f-abc1-46ca-b6d3-5854c70c886e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.137885] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3654b92f-abc1-46ca-b6d3-5854c70c886e: rpc.has_security_group_logging(os_id): False [ 728.172857] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.172857] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.172857] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.172857] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.172857] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.172857] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.172857] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.172857] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.176315] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.176315] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.176315] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3654b92f-abc1-46ca-b6d3-5854c70c886e is going to be created. [ 728.278245] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.278626] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.278626] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.278718] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.280122] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.294565] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3654b92f-abc1-46ca-b6d3-5854c70c886e in Status: IN_PROGRESS for 2s [ 728.550471] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 728.550471] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 729.235797] env[65783]: INFO networking_nsxv3.common.synchronization [req-49d15ef4-3c5e-4da3-aa90-b22d3ec41eba req-b7c4bb7c-a8b8-4526-9dae-666da084bc1b tempest-ServerDiskConfigTestJSON-664757069 tempest-ServerDiskConfigTestJSON-664757069-project-member] Enqueued Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 729.236360] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 729.236666] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.236784] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.236842] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.238471] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.238673] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.238798] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.238866] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.239056] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.239145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.239239] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.404409] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e in Status: SUCCESS [ 729.404409] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.741970] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.741970] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.741970] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.742292] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.742511] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.742838] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.743114] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.743114] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.743412] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.743488] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.743641] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 is going to be updated. [ 729.777687] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.777839] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.777913] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.779339] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.779339] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.789094] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: IN_PROGRESS for 2s [ 730.312317] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3654b92f-abc1-46ca-b6d3-5854c70c886e in Status: SUCCESS [ 730.312317] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.244441] env[65783]: INFO networking_nsxv3.common.synchronization [req-2437f957-ea2a-418e-99ee-21139b56d33e req-0b086901-0a17-481f-8e7a-efa44a669554 tempest-ServerAddressesNegativeTestJSON-497890566 tempest-ServerAddressesNegativeTestJSON-497890566-project-member] Enqueued Resource ID: b56f5230-554e-48f1-aef4-fcf2593b50d3 with Priority: HIGHEST for action security_group_members [ 731.245016] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b56f5230-554e-48f1-aef4-fcf2593b50d3 with Priority: HIGHEST for action security_group_members [ 731.245804] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b56f5230-554e-48f1-aef4-fcf2593b50d3 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.245804] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.245804] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.245804] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.246136] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.246136] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.246227] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.246973] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.246973] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.246973] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b56f5230-554e-48f1-aef4-fcf2593b50d3',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.751254] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.751254] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.751254] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.751254] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.751254] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.751254] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.751254] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.751254] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.751254] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.751254] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.751254] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b56f5230-554e-48f1-aef4-fcf2593b50d3 already deleted. [ 731.751254] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.763393] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-660 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.763393] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-660" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.763393] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-660" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.763393] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-660" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.763581] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.763658] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.763761] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.764552] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.764552] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.764552] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 731.764552] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 731.764699] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 731.764771] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 731.764827] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 731.764922] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 731.765099] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 731.790532] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 731.790734] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 731.790958] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 731.791167] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-660" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.791511] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-3c6f2879-19ae-45b8-8785-45987a597a6a taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.791683] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-3c6f2879-19ae-45b8-8785-45987a597a6a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.791798] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-3c6f2879-19ae-45b8-8785-45987a597a6a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.792160] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-3c6f2879-19ae-45b8-8785-45987a597a6a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.792314] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c6f2879-19ae-45b8-8785-45987a597a6a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.803356] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: SUCCESS [ 731.803695] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 deletion is rescheduled due to dependency. [ 731.803695] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.295368] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.295893] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.295989] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.296425] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.296582] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.296843] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 3c6f2879-19ae-45b8-8785-45987a597a6a not found, creating... [ 732.297447] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.297649] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.298016] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.298310] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.298585] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.299146] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.299405] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.299606] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.299890] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.300045] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.300247] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 3c6f2879-19ae-45b8-8785-45987a597a6a is going to be created. [ 732.327983] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.327983] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.327983] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.327983] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.327983] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.327983] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-3c6f2879-19ae-45b8-8785-45987a597a6a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.280059] env[65783]: INFO networking_nsxv3.common.synchronization [None req-b0e0fb2b-97d1-4d16-a0aa-94d927a18904 None None] Enqueued Resource ID: 2eeb3101-6006-455a-8b9b-5f9c4a5d2ccb with Priority: HIGHEST for action port [ 733.280059] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eeb3101-6006-455a-8b9b-5f9c4a5d2ccb with Priority: HIGHEST for action port [ 733.281018] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-2eeb3101-6006-455a-8b9b-5f9c4a5d2ccb taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.281018] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2eeb3101-6006-455a-8b9b-5f9c4a5d2ccb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.281018] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2eeb3101-6006-455a-8b9b-5f9c4a5d2ccb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.281249] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2eeb3101-6006-455a-8b9b-5f9c4a5d2ccb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.281357] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2eeb3101-6006-455a-8b9b-5f9c4a5d2ccb',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.545808] env[65783]: INFO networking_nsxv3.common.synchronization [req-2437f957-ea2a-418e-99ee-21139b56d33e req-6a70832d-521b-448d-8595-d0c17fc5f8b4 service nova] Enqueued Resource ID: b56f5230-554e-48f1-aef4-fcf2593b50d3 with Priority: HIGHEST for action security_group_rules [ 733.546080] env[65783]: INFO networking_nsxv3.common.synchronization [req-2437f957-ea2a-418e-99ee-21139b56d33e req-6a70832d-521b-448d-8595-d0c17fc5f8b4 service nova] Enqueued Resource ID: b56f5230-554e-48f1-aef4-fcf2593b50d3 with Priority: HIGHEST for action security_group_members [ 733.546222] env[65783]: INFO networking_nsxv3.common.synchronization [req-2437f957-ea2a-418e-99ee-21139b56d33e req-6a70832d-521b-448d-8595-d0c17fc5f8b4 service nova] Enqueued Resource ID: 3c6f2879-19ae-45b8-8785-45987a597a6a with Priority: HIGHEST for action port [ 733.549476] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b56f5230-554e-48f1-aef4-fcf2593b50d3 with Priority: HIGHEST for action security_group_rules [ 733.549476] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b56f5230-554e-48f1-aef4-fcf2593b50d3 with Priority: HIGHEST for action security_group_members [ 733.549476] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c6f2879-19ae-45b8-8785-45987a597a6a with Priority: HIGHEST for action port [ 733.549476] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b56f5230-554e-48f1-aef4-fcf2593b50d3 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.549476] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.549476] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.549476] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.549476] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b56f5230-554e-48f1-aef4-fcf2593b50d3',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.549905] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b56f5230-554e-48f1-aef4-fcf2593b50d3 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.549951] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.550854] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.550854] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.550854] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.550854] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.550854] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.550854] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.550854] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.551285] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b56f5230-554e-48f1-aef4-fcf2593b50d3',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.551967] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c6f2879-19ae-45b8-8785-45987a597a6a taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.552115] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c6f2879-19ae-45b8-8785-45987a597a6a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.552232] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c6f2879-19ae-45b8-8785-45987a597a6a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.552408] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c6f2879-19ae-45b8-8785-45987a597a6a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.552714] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c6f2879-19ae-45b8-8785-45987a597a6a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.783197] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2eeb3101-6006-455a-8b9b-5f9c4a5d2ccb [ 733.783441] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.784024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.784024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.784219] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.784219] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.784219] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2eeb3101-6006-455a-8b9b-5f9c4a5d2ccb already deleted. [ 733.784332] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2eeb3101-6006-455a-8b9b-5f9c4a5d2ccb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.907698] env[65783]: INFO networking_nsxv3.common.synchronization [req-7dd4af81-579e-48dd-b47b-648220e4132e req-6e5567a5-d75d-4c2e-85e2-4525dc54a2f6 tempest-ServerActionsTestOtherA-298845163 tempest-ServerActionsTestOtherA-298845163-project-member] Enqueued Resource ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 with Priority: HIGHEST for action security_group_members [ 733.909215] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 with Priority: HIGHEST for action security_group_members [ 733.909725] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.909725] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.909837] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.910113] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.910113] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.910349] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.910349] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.910509] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.910563] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.910646] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6dc57fb-f44d-4b26-87fe-bb8e4df202a8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.054433] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b56f5230-554e-48f1-aef4-fcf2593b50d3 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.056952] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.057316] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b56f5230-554e-48f1-aef4-fcf2593b50d3',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.058253] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3c6f2879-19ae-45b8-8785-45987a597a6a with status ACTIVE [ 734.058504] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.059167] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.059274] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.059513] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.060236] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.060468] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.060606] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.060703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.061367] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.061367] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.061367] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.061367] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.062298] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.063696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.063696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.063696] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3c6f2879-19ae-45b8-8785-45987a597a6a is going to be updated. [ 734.088710] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.088850] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.089387] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.089387] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.089387] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.089501] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c6f2879-19ae-45b8-8785-45987a597a6a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.181974] env[65783]: INFO networking_nsxv3.common.synchronization [req-398c87b9-72e8-4766-9962-7a9a33257b08 req-6be9e065-59a5-4ec9-a0f7-a2c36b3ef7bb tempest-InstanceActionsTestJSON-1234363326 tempest-InstanceActionsTestJSON-1234363326-project-member] Enqueued Resource ID: b4233009-fbd8-4936-abda-bc37e3d37b55 with Priority: HIGHEST for action security_group_members [ 734.181974] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4233009-fbd8-4936-abda-bc37e3d37b55 with Priority: HIGHEST for action security_group_members [ 734.182710] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4233009-fbd8-4936-abda-bc37e3d37b55 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.183716] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.183716] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.183716] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.183716] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.183716] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.183716] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.184023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.184023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.184023] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4233009-fbd8-4936-abda-bc37e3d37b55',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.413819] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.414026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.414081] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.414411] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.414411] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.414641] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.414765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.414840] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.415058] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.415130] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.415219] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 is going to be updated. [ 734.447583] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.447760] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.447847] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.448141] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.448320] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.461296] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 in Status: IN_PROGRESS for 2s [ 734.566906] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b56f5230-554e-48f1-aef4-fcf2593b50d3',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.596724] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-239 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.596905] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-239" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.597038] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-239" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.597375] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-239" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.597611] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.598394] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.598564] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.598787] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.598944] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.599154] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 734.599256] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 734.599353] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 734.599450] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 734.599545] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 734.599638] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 734.599756] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 734.621216] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 734.621443] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 734.621503] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 734.621643] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-239" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.621981] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-35fcd817-c75c-40df-beb8-b13fe638dd50 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.622200] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-35fcd817-c75c-40df-beb8-b13fe638dd50" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.622338] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-35fcd817-c75c-40df-beb8-b13fe638dd50" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.622605] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-35fcd817-c75c-40df-beb8-b13fe638dd50" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.622739] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35fcd817-c75c-40df-beb8-b13fe638dd50',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.688020] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.688020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.688020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.688020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.688020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.688020] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.688020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.688020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.688020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.688020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.688020] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4233009-fbd8-4936-abda-bc37e3d37b55 already deleted. [ 734.688448] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.069639] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.069859] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.069859] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.070750] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.070750] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.070750] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b56f5230-554e-48f1-aef4-fcf2593b50d3 is going to be created. [ 735.094081] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.094081] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.094081] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.094367] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.094402] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.106303] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b56f5230-554e-48f1-aef4-fcf2593b50d3 in Status: UNINITIALIZED for 2s [ 735.124822] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.125104] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.125177] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.125430] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.125576] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.125718] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 35fcd817-c75c-40df-beb8-b13fe638dd50 not found, creating... [ 735.125963] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.126123] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.126253] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.126453] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.126580] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.126843] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.126989] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.127110] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.127301] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.127468] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.127596] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 35fcd817-c75c-40df-beb8-b13fe638dd50 is going to be created. [ 735.155391] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.155391] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.155391] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.155684] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.156705] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.156705] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-35fcd817-c75c-40df-beb8-b13fe638dd50" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.272134] env[65783]: INFO networking_nsxv3.common.synchronization [None req-ec9aa001-925e-4f80-9d13-83beb7f7b8ab tempest-AttachInterfacesUnderV243Test-2037762512 tempest-AttachInterfacesUnderV243Test-2037762512-project-member] Enqueued Resource ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 with Priority: HIGHEST for action security_group_rules [ 735.272762] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 with Priority: HIGHEST for action security_group_rules [ 735.273730] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.273912] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.273996] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.274618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.274618] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9af7ce2b-d35d-49a7-a534-d4ea3a2a2508',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.799347] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.799347] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.799347] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.799347] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.799347] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.799347] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 already deleted. [ 735.799347] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.904274] env[65783]: INFO networking_nsxv3.common.synchronization [req-398c87b9-72e8-4766-9962-7a9a33257b08 req-0b4eb457-4446-4908-b69c-8430318d3933 service nova] Enqueued Resource ID: b4233009-fbd8-4936-abda-bc37e3d37b55 with Priority: HIGHEST for action security_group_rules [ 735.904506] env[65783]: INFO networking_nsxv3.common.synchronization [req-398c87b9-72e8-4766-9962-7a9a33257b08 req-0b4eb457-4446-4908-b69c-8430318d3933 service nova] Enqueued Resource ID: b4233009-fbd8-4936-abda-bc37e3d37b55 with Priority: HIGHEST for action security_group_members [ 735.904676] env[65783]: INFO networking_nsxv3.common.synchronization [req-398c87b9-72e8-4766-9962-7a9a33257b08 req-0b4eb457-4446-4908-b69c-8430318d3933 service nova] Enqueued Resource ID: 35fcd817-c75c-40df-beb8-b13fe638dd50 with Priority: HIGHEST for action port [ 735.905294] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4233009-fbd8-4936-abda-bc37e3d37b55 with Priority: HIGHEST for action security_group_rules [ 735.905548] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4233009-fbd8-4936-abda-bc37e3d37b55 with Priority: HIGHEST for action security_group_members [ 735.905645] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35fcd817-c75c-40df-beb8-b13fe638dd50 with Priority: HIGHEST for action port [ 735.905896] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4233009-fbd8-4936-abda-bc37e3d37b55 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.906048] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.906133] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.906444] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.906444] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4233009-fbd8-4936-abda-bc37e3d37b55',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.907426] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4233009-fbd8-4936-abda-bc37e3d37b55 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.907516] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.907516] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.907704] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.907825] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.907911] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.908106] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.908168] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.908219] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.908296] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4233009-fbd8-4936-abda-bc37e3d37b55',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.909826] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-35fcd817-c75c-40df-beb8-b13fe638dd50 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.909969] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35fcd817-c75c-40df-beb8-b13fe638dd50" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.910145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35fcd817-c75c-40df-beb8-b13fe638dd50" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.910297] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35fcd817-c75c-40df-beb8-b13fe638dd50" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.910297] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35fcd817-c75c-40df-beb8-b13fe638dd50',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.969909] env[65783]: INFO networking_nsxv3.common.synchronization [None req-773df277-1542-4959-b200-38a10c758e22 tempest-AttachInterfacesUnderV243Test-2037762512 tempest-AttachInterfacesUnderV243Test-2037762512-project-member] Enqueued Resource ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 with Priority: HIGHEST for action security_group_rules [ 735.974987] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 with Priority: HIGHEST for action security_group_rules [ 735.974987] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.974987] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.974987] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.974987] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.974987] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9af7ce2b-d35d-49a7-a534-d4ea3a2a2508',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.066209] env[65783]: INFO networking_nsxv3.common.synchronization [None req-6fcb4a61-24e9-4727-aed2-67b660631272 None None] Enqueued Resource ID: e548033d-87d0-4e20-9713-8a56be88555f with Priority: HIGHEST for action port [ 736.066209] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e548033d-87d0-4e20-9713-8a56be88555f with Priority: HIGHEST for action port [ 736.066342] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-e548033d-87d0-4e20-9713-8a56be88555f taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.066502] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e548033d-87d0-4e20-9713-8a56be88555f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.066589] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e548033d-87d0-4e20-9713-8a56be88555f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.066830] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e548033d-87d0-4e20-9713-8a56be88555f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.066926] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e548033d-87d0-4e20-9713-8a56be88555f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.412824] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4233009-fbd8-4936-abda-bc37e3d37b55',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.413909] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4233009-fbd8-4936-abda-bc37e3d37b55 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.414104] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.414199] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 35fcd817-c75c-40df-beb8-b13fe638dd50 with status ACTIVE [ 736.414354] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.414457] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.414521] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.414776] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.414816] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.414947] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.415107] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.415107] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.415516] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.415516] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.415516] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.415999] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.415999] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.415999] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.415999] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.415999] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 35fcd817-c75c-40df-beb8-b13fe638dd50 is going to be updated. [ 736.442844] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.443036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.443120] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.443377] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.443545] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.443769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35fcd817-c75c-40df-beb8-b13fe638dd50" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.470389] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 in Status: SUCCESS [ 736.470585] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 deletion is rescheduled due to dependency. [ 736.470709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.506116] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.506713] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.506713] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.506713] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.506713] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.506713] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 already deleted. [ 736.506896] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.574034] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e548033d-87d0-4e20-9713-8a56be88555f [ 736.574034] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.574034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.574034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.574034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.574034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.574034] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e548033d-87d0-4e20-9713-8a56be88555f already deleted. [ 736.574034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e548033d-87d0-4e20-9713-8a56be88555f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.892683] env[65783]: INFO networking_nsxv3.common.synchronization [req-ec9b5877-196d-4c7a-8259-609959abfcda req-977f4a9f-975e-4159-b4a8-ffdcd28cc492 tempest-MigrationsAdminTest-1412758904 tempest-MigrationsAdminTest-1412758904-project-member] Enqueued Resource ID: b6e66254-5e43-437b-850b-825eaaa0cee1 with Priority: HIGHEST for action security_group_members [ 736.893376] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e66254-5e43-437b-850b-825eaaa0cee1 with Priority: HIGHEST for action security_group_members [ 736.893719] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e66254-5e43-437b-850b-825eaaa0cee1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.896748] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.896748] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.896748] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.897053] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.897237] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.897666] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.897914] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.898103] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.898355] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6e66254-5e43-437b-850b-825eaaa0cee1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.918285] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4233009-fbd8-4936-abda-bc37e3d37b55',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.121994] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b56f5230-554e-48f1-aef4-fcf2593b50d3 in Status: SUCCESS [ 737.121994] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.121994] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.121994] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.121994] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.121994] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.121994] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.121994] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.121994] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.122368] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.122368] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b56f5230-554e-48f1-aef4-fcf2593b50d3',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.403563] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b6e66254-5e43-437b-850b-825eaaa0cee1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.421359] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.421934] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.421934] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.422064] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.422476] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.425099] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4233009-fbd8-4936-abda-bc37e3d37b55 is going to be created. [ 737.454346] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.454346] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.454346] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.454346] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.454346] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.470860] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4233009-fbd8-4936-abda-bc37e3d37b55 in Status: UNINITIALIZED for 2s [ 737.481617] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-251 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.481943] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.482146] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.482451] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.482750] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.483462] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.483462] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.483462] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.483638] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.483777] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 737.483880] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 737.483986] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 737.484086] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 737.484192] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 737.484305] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 737.484451] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 737.521716] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 737.522373] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 737.523060] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 737.523060] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.523446] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-04994181-be30-4c51-b4a1-ce198600a5c3 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.523650] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-04994181-be30-4c51-b4a1-ce198600a5c3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.523775] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-04994181-be30-4c51-b4a1-ce198600a5c3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.524287] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-04994181-be30-4c51-b4a1-ce198600a5c3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.524441] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04994181-be30-4c51-b4a1-ce198600a5c3',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.624365] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b56f5230-554e-48f1-aef4-fcf2593b50d3 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.624801] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.625387] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.625387] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.626228] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.626404] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.626484] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.626708] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.626842] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.627086] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.627250] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b56f5230-554e-48f1-aef4-fcf2593b50d3 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.627389] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.627424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.627630] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.627812] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.627953] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.628064] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.628271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.628397] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.628520] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.628663] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b56f5230-554e-48f1-aef4-fcf2593b50d3',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.906688] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b6e66254-5e43-437b-850b-825eaaa0cee1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.027268] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.027488] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.027710] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.027867] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.028012] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.028152] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 04994181-be30-4c51-b4a1-ce198600a5c3 not found, creating... [ 738.028947] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.028947] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.028947] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.028947] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.029382] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.029382] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.029473] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.029568] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.029786] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.029919] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.030262] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 04994181-be30-4c51-b4a1-ce198600a5c3 is going to be created. [ 738.052352] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.052552] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.052666] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.052929] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.053182] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.053462] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-04994181-be30-4c51-b4a1-ce198600a5c3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.132477] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b56f5230-554e-48f1-aef4-fcf2593b50d3: rpc.has_security_group_logging(os_id): False [ 738.153712] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.153712] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.153925] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.154027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.154237] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.154402] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.154479] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.154611] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.154662] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.154737] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.154920] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.154987] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.155078] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.155218] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.155291] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.155470] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.155563] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.155622] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.155756] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.155828] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.155910] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b56f5230-554e-48f1-aef4-fcf2593b50d3 is going to be created. [ 738.258686] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.259017] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.259193] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.259535] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.259727] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.272802] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b56f5230-554e-48f1-aef4-fcf2593b50d3 in Status: IN_PROGRESS for 2s [ 738.409406] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.409663] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.409663] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.410162] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.410162] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.410743] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6e66254-5e43-437b-850b-825eaaa0cee1 is going to be updated. [ 738.440782] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.441119] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.441119] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.441200] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.441343] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.452797] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6e66254-5e43-437b-850b-825eaaa0cee1 in Status: IN_PROGRESS for 2s [ 738.733177] env[65783]: INFO networking_nsxv3.common.synchronization [req-ec9b5877-196d-4c7a-8259-609959abfcda req-4eeba55b-0ce0-4aea-b584-2941f2a7f28b service nova] Enqueued Resource ID: b6e66254-5e43-437b-850b-825eaaa0cee1 with Priority: HIGHEST for action security_group_rules [ 738.733415] env[65783]: INFO networking_nsxv3.common.synchronization [req-ec9b5877-196d-4c7a-8259-609959abfcda req-4eeba55b-0ce0-4aea-b584-2941f2a7f28b service nova] Enqueued Resource ID: b6e66254-5e43-437b-850b-825eaaa0cee1 with Priority: HIGHEST for action security_group_members [ 738.733552] env[65783]: INFO networking_nsxv3.common.synchronization [req-ec9b5877-196d-4c7a-8259-609959abfcda req-4eeba55b-0ce0-4aea-b584-2941f2a7f28b service nova] Enqueued Resource ID: 04994181-be30-4c51-b4a1-ce198600a5c3 with Priority: HIGHEST for action port [ 738.734319] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e66254-5e43-437b-850b-825eaaa0cee1 with Priority: HIGHEST for action security_group_rules [ 738.734319] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e66254-5e43-437b-850b-825eaaa0cee1 with Priority: HIGHEST for action security_group_members [ 738.734503] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04994181-be30-4c51-b4a1-ce198600a5c3 with Priority: HIGHEST for action port [ 738.734986] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6e66254-5e43-437b-850b-825eaaa0cee1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.734986] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.735181] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.735217] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.735309] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6e66254-5e43-437b-850b-825eaaa0cee1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.736132] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e66254-5e43-437b-850b-825eaaa0cee1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.736433] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.736433] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-04994181-be30-4c51-b4a1-ce198600a5c3 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.736544] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04994181-be30-4c51-b4a1-ce198600a5c3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.736544] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04994181-be30-4c51-b4a1-ce198600a5c3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.737355] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04994181-be30-4c51-b4a1-ce198600a5c3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.737355] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04994181-be30-4c51-b4a1-ce198600a5c3',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.238920] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e66254-5e43-437b-850b-825eaaa0cee1 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.239256] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.240645] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 04994181-be30-4c51-b4a1-ce198600a5c3 with status ACTIVE [ 739.240777] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.240894] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.240894] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.241150] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.241243] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.241613] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.241743] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.241806] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.241968] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.242056] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.242290] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.243694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.243694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.243694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.243694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.243694] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 04994181-be30-4c51-b4a1-ce198600a5c3 is going to be updated. [ 739.281355] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.281355] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.281355] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.281355] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.281355] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.281355] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04994181-be30-4c51-b4a1-ce198600a5c3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.413207] env[65783]: INFO networking_nsxv3.common.synchronization [req-f55f3ee1-5cf9-4da9-87d7-0c37d8162dbc req-d9a18749-0864-45ed-8275-9822eb672d4b tempest-ImagesTestJSON-433702528 tempest-ImagesTestJSON-433702528-project-member] Enqueued Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 739.415799] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 739.416837] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.416837] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.416837] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.417054] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.417185] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.417277] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.417334] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.417475] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.417556] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.417648] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.482881] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4233009-fbd8-4936-abda-bc37e3d37b55 in Status: SUCCESS [ 739.483131] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.483294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.483633] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.483792] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.483907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.483972] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.484143] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.484224] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.484306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.484408] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4233009-fbd8-4936-abda-bc37e3d37b55',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.822880] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-509 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.822880] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-509" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.823208] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-509" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.823251] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-509" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.823511] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.823666] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.823937] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.823983] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.825848] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.827206] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 739.827300] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 739.828079] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 739.828079] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 739.828079] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 739.828079] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 739.828079] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 739.859251] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 739.859251] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 739.860264] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 739.860264] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-509" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.860264] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-a490dde6-7a99-4085-9de3-e81116f08231 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.860613] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-a490dde6-7a99-4085-9de3-e81116f08231" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.861010] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-a490dde6-7a99-4085-9de3-e81116f08231" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.862084] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-a490dde6-7a99-4085-9de3-e81116f08231" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.862084] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a490dde6-7a99-4085-9de3-e81116f08231',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.919791] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.920155] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.920298] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.920514] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.920687] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.920946] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.921132] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.921240] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.921537] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.921677] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.921807] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd942bf-b305-4707-8084-1ac6b135c741 is going to be updated. [ 739.954561] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.954708] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.954868] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.954991] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.955177] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.968232] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: IN_PROGRESS for 2s [ 739.986823] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4233009-fbd8-4936-abda-bc37e3d37b55 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.986988] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.987339] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.987339] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.987524] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.987678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.987678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.987844] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.987922] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.988046] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.988166] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4233009-fbd8-4936-abda-bc37e3d37b55 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.988262] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.988309] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.988443] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.988588] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.988661] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.988720] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.988852] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.988938] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.989077] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.989204] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4233009-fbd8-4936-abda-bc37e3d37b55',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.286309] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b56f5230-554e-48f1-aef4-fcf2593b50d3 in Status: SUCCESS [ 740.286631] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.366614] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.366984] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.367105] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.367427] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.367641] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.367869] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port a490dde6-7a99-4085-9de3-e81116f08231 not found, creating... [ 740.368305] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.368496] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.368622] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.368884] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.369073] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.369379] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.369533] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.369642] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.369890] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.370168] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.370348] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: a490dde6-7a99-4085-9de3-e81116f08231 is going to be created. [ 740.394855] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.395631] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.395631] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.395735] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.396183] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.396516] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-a490dde6-7a99-4085-9de3-e81116f08231" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.463773] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6e66254-5e43-437b-850b-825eaaa0cee1 in Status: SUCCESS [ 740.463773] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.464122] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.464122] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.464363] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.464528] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.464528] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.464728] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.464728] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.465040] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6e66254-5e43-437b-850b-825eaaa0cee1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.491409] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4233009-fbd8-4936-abda-bc37e3d37b55: rpc.has_security_group_logging(os_id): False [ 740.530090] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.530592] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.530592] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.530725] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.530821] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.531105] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.531208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.531339] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.531479] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.531571] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.531786] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.531903] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.532038] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.532214] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.532311] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.532516] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.532619] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.532677] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.532823] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.532969] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.533040] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4233009-fbd8-4936-abda-bc37e3d37b55 is going to be created. [ 740.604277] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.604482] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.604522] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.604747] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.604949] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.615823] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4233009-fbd8-4936-abda-bc37e3d37b55 in Status: IN_PROGRESS for 2s [ 740.968065] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b6e66254-5e43-437b-850b-825eaaa0cee1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.153279] env[65783]: INFO networking_nsxv3.common.synchronization [req-f55f3ee1-5cf9-4da9-87d7-0c37d8162dbc req-af0ac449-ea54-4231-b16c-472c1574154a service nova] Enqueued Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_rules [ 741.153279] env[65783]: INFO networking_nsxv3.common.synchronization [req-f55f3ee1-5cf9-4da9-87d7-0c37d8162dbc req-af0ac449-ea54-4231-b16c-472c1574154a service nova] Enqueued Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 741.153279] env[65783]: INFO networking_nsxv3.common.synchronization [req-f55f3ee1-5cf9-4da9-87d7-0c37d8162dbc req-af0ac449-ea54-4231-b16c-472c1574154a service nova] Enqueued Resource ID: a490dde6-7a99-4085-9de3-e81116f08231 with Priority: HIGHEST for action port [ 741.153279] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_rules [ 741.153279] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 741.153279] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a490dde6-7a99-4085-9de3-e81116f08231 with Priority: HIGHEST for action port [ 741.153754] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.154025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.154263] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.154569] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.154831] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.155981] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.156261] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.156816] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-a490dde6-7a99-4085-9de3-e81116f08231 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.157259] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a490dde6-7a99-4085-9de3-e81116f08231" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.157596] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a490dde6-7a99-4085-9de3-e81116f08231" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.157918] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a490dde6-7a99-4085-9de3-e81116f08231" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.159393] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a490dde6-7a99-4085-9de3-e81116f08231',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.471841] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b6e66254-5e43-437b-850b-825eaaa0cee1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.659931] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.660227] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.660448] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a490dde6-7a99-4085-9de3-e81116f08231 with status ACTIVE [ 741.660624] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.661206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.661206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.661206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.661206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.661359] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.661421] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.661521] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.661776] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.662465] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.662465] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.662465] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.662465] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.662465] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.662465] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.662795] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a490dde6-7a99-4085-9de3-e81116f08231 is going to be updated. [ 741.686732] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.686732] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.686732] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.686885] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.686885] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.687106] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a490dde6-7a99-4085-9de3-e81116f08231" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.972716] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.972936] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.973584] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.973584] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.973752] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.974032] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6e66254-5e43-437b-850b-825eaaa0cee1 is going to be updated. [ 741.983663] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: SUCCESS [ 741.983872] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd942bf-b305-4707-8084-1ac6b135c741 deletion is rescheduled due to dependency. [ 741.983985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.984176] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.984503] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.984565] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.984676] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.984743] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.984954] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.985056] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.985152] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.007635] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.007803] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.007889] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.009180] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.009180] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.019458] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6e66254-5e43-437b-850b-825eaaa0cee1 in Status: IN_PROGRESS for 2s [ 742.490906] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.631075] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4233009-fbd8-4936-abda-bc37e3d37b55 in Status: SUCCESS [ 742.631321] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.996023] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.499714] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.500145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.500252] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.500851] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.501040] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.501154] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd942bf-b305-4707-8084-1ac6b135c741 is going to be updated. [ 743.541651] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.541972] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.541972] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.542241] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.542390] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.554129] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: IN_PROGRESS for 2s [ 744.031569] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6e66254-5e43-437b-850b-825eaaa0cee1 in Status: SUCCESS [ 744.031569] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.031569] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.031569] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.032065] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.032065] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.032065] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.032213] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.032213] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.032287] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.032365] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b6e66254-5e43-437b-850b-825eaaa0cee1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.535425] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e66254-5e43-437b-850b-825eaaa0cee1 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.535720] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.535720] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.535919] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.536112] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.536211] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.536274] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.540017] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.540017] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.540017] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.540017] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e66254-5e43-437b-850b-825eaaa0cee1 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.540017] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.540017] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.540017] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.540017] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.540017] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.540017] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.540017] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.540017] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.540017] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.540017] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b6e66254-5e43-437b-850b-825eaaa0cee1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.922363] env[65783]: INFO networking_nsxv3.common.synchronization [None req-522ff827-31af-46dd-b354-0ed00c060a73 None None] Enqueued Resource ID: cea60202-1ba6-465c-8ca2-64370152b03e with Priority: HIGHEST for action port [ 744.924621] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cea60202-1ba6-465c-8ca2-64370152b03e with Priority: HIGHEST for action port [ 744.924814] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-cea60202-1ba6-465c-8ca2-64370152b03e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.924949] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cea60202-1ba6-465c-8ca2-64370152b03e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.925126] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cea60202-1ba6-465c-8ca2-64370152b03e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.927036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cea60202-1ba6-465c-8ca2-64370152b03e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.927036] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cea60202-1ba6-465c-8ca2-64370152b03e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.042449] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b6e66254-5e43-437b-850b-825eaaa0cee1: rpc.has_security_group_logging(os_id): False [ 745.067875] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.068052] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.068208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.068555] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.068741] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.068978] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.069162] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.069283] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.069591] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.069728] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.070426] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.070630] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.070756] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.071047] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.071333] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.075141] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.075289] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.075353] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.075699] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.075798] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.075904] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6e66254-5e43-437b-850b-825eaaa0cee1 is going to be updated. [ 745.165278] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.166520] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.166520] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.166520] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.166520] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.186027] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6e66254-5e43-437b-850b-825eaaa0cee1 in Status: IN_PROGRESS for 2s [ 745.430432] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cea60202-1ba6-465c-8ca2-64370152b03e [ 745.431032] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.431032] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.431032] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.431544] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.431544] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.431544] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cea60202-1ba6-465c-8ca2-64370152b03e already deleted. [ 745.431544] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cea60202-1ba6-465c-8ca2-64370152b03e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.570033] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: SUCCESS [ 745.573019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.573019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.573019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.573019] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.573019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.573019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.573019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.573019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.573019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.573019] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.083034] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.083034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.083034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.083034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.083034] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.083034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.083034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.083034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.083034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.083034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.083034] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.083034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.083034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.083034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.083034] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.083034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.083847] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.083847] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.083847] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.083847] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.083847] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.587089] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for efd942bf-b305-4707-8084-1ac6b135c741: rpc.has_security_group_logging(os_id): False [ 746.610974] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.611293] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.611386] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.611604] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.611768] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.612073] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.612157] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.612191] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.612330] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.612405] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.612590] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.612752] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.612816] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.613115] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.613115] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.613282] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.613282] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.613598] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.613598] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.613598] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.613598] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efd942bf-b305-4707-8084-1ac6b135c741 is going to be updated. [ 746.678236] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.678236] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.678236] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.678469] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.680475] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.697411] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: IN_PROGRESS for 2s [ 747.201026] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6e66254-5e43-437b-850b-825eaaa0cee1 in Status: SUCCESS [ 747.201239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.335360] env[65783]: INFO networking_nsxv3.common.synchronization [None req-56d1a00c-72b7-4604-b8dc-6d80b82a89b2 None None] Enqueued Resource ID: d9691223-4f29-4a8e-a9d4-a0628cd946dd with Priority: HIGHEST for action port [ 747.335623] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9691223-4f29-4a8e-a9d4-a0628cd946dd with Priority: HIGHEST for action port [ 747.336384] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9691223-4f29-4a8e-a9d4-a0628cd946dd taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.336384] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9691223-4f29-4a8e-a9d4-a0628cd946dd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.336586] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9691223-4f29-4a8e-a9d4-a0628cd946dd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.336654] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9691223-4f29-4a8e-a9d4-a0628cd946dd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.336731] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9691223-4f29-4a8e-a9d4-a0628cd946dd',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.840511] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d9691223-4f29-4a8e-a9d4-a0628cd946dd [ 747.840940] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.841080] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.841193] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.841497] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.841662] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.841786] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d9691223-4f29-4a8e-a9d4-a0628cd946dd already deleted. [ 747.841928] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9691223-4f29-4a8e-a9d4-a0628cd946dd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.714985] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: SUCCESS [ 748.715242] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.168035] env[65783]: INFO networking_nsxv3.common.synchronization [req-624d3005-35ce-4ab8-a0e6-1b7a838c58e2 req-85840904-2406-40ad-acca-becee75a7956 tempest-ServersAdminTestJSON-345343376 tempest-ServersAdminTestJSON-345343376-project-member] Enqueued Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_members [ 749.168463] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_members [ 749.168757] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca99b1a6-3702-4011-942b-06036fda2165 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.169581] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.169581] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.169581] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.169581] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.170596] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.170596] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.170596] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.170701] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.170762] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.448724] env[65783]: INFO networking_nsxv3.common.synchronization [req-8a5a9a5f-de38-48a9-96f7-77123f2a0bb3 req-e5243e9f-ead1-4eb6-b7ac-76fb4b255263 tempest-FloatingIPsAssociationTestJSON-1491106384 tempest-FloatingIPsAssociationTestJSON-1491106384-project-member] Enqueued Resource ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e with Priority: HIGHEST for action security_group_members [ 749.449327] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e with Priority: HIGHEST for action security_group_members [ 749.449933] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.450222] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.450222] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.450731] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.450731] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.450879] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.450879] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.451226] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.451226] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.451315] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d536ed15-4c4c-44ea-b9bd-1b0e46123d7e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.556472] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-714 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.556718] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-714" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.556851] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-714" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.557170] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-714" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.557554] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.557790] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.557947] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.558212] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.558488] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.558758] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 749.559085] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 749.559279] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 749.559425] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 749.559573] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 749.559708] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 749.559865] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 749.589971] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 749.590136] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 749.590280] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 749.590456] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-714" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.592328] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-ea77fa15-d004-4f6d-bea0-02027383b034 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.592575] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-ea77fa15-d004-4f6d-bea0-02027383b034" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.592652] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-ea77fa15-d004-4f6d-bea0-02027383b034" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.592978] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-ea77fa15-d004-4f6d-bea0-02027383b034" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.593146] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea77fa15-d004-4f6d-bea0-02027383b034',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.674349] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.812869] env[65783]: INFO networking_nsxv3.common.synchronization [req-a1403ca6-17f0-4d09-85e8-215ab86fedc6 req-cda8db17-fde7-4d40-a729-c6b20f23117d tempest-ServerAddressesNegativeTestJSON-497890566 tempest-ServerAddressesNegativeTestJSON-497890566-project-member] Enqueued Resource ID: b56f5230-554e-48f1-aef4-fcf2593b50d3 with Priority: HIGHEST for action security_group_members [ 749.814496] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b56f5230-554e-48f1-aef4-fcf2593b50d3 with Priority: HIGHEST for action security_group_members [ 749.815230] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b56f5230-554e-48f1-aef4-fcf2593b50d3 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.815230] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.815230] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.815440] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.815643] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.815793] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.815901] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.816115] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.816236] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.816352] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b56f5230-554e-48f1-aef4-fcf2593b50d3',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.953440] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d536ed15-4c4c-44ea-b9bd-1b0e46123d7e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.095322] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.095622] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.095622] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.095908] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.096645] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.096645] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port ea77fa15-d004-4f6d-bea0-02027383b034 not found, creating... [ 750.097136] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.097136] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.097386] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.097659] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.097860] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.098222] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.098497] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.098711] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.099145] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.099680] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.099680] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: ea77fa15-d004-4f6d-bea0-02027383b034 is going to be created. [ 750.124274] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.124616] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.124687] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.124984] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.125218] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.125445] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-ea77fa15-d004-4f6d-bea0-02027383b034" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.176609] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.321190] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.321558] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.321558] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.321751] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.321897] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.322250] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.323820] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.323820] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.323820] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.323820] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.323820] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b56f5230-554e-48f1-aef4-fcf2593b50d3 is going to be updated. [ 750.354995] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.355240] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.355240] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.355525] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.355614] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.370896] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b56f5230-554e-48f1-aef4-fcf2593b50d3 in Status: IN_PROGRESS for 2s [ 750.456057] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d536ed15-4c4c-44ea-b9bd-1b0e46123d7e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.681282] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.681282] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.681282] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.681282] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.681282] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.681282] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca99b1a6-3702-4011-942b-06036fda2165 is going to be updated. [ 750.714201] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.714347] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.714416] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.714692] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.714837] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.726994] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: IN_PROGRESS for 2s [ 750.874911] env[65783]: INFO networking_nsxv3.common.synchronization [req-624d3005-35ce-4ab8-a0e6-1b7a838c58e2 req-898742e2-5801-4c52-8b18-716a5f550437 service nova] Enqueued Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_rules [ 750.875126] env[65783]: INFO networking_nsxv3.common.synchronization [req-624d3005-35ce-4ab8-a0e6-1b7a838c58e2 req-898742e2-5801-4c52-8b18-716a5f550437 service nova] Enqueued Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_members [ 750.875279] env[65783]: INFO networking_nsxv3.common.synchronization [req-624d3005-35ce-4ab8-a0e6-1b7a838c58e2 req-898742e2-5801-4c52-8b18-716a5f550437 service nova] Enqueued Resource ID: ea77fa15-d004-4f6d-bea0-02027383b034 with Priority: HIGHEST for action port [ 750.875803] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_rules [ 750.875957] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_members [ 750.878426] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea77fa15-d004-4f6d-bea0-02027383b034 with Priority: HIGHEST for action port [ 750.878426] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca99b1a6-3702-4011-942b-06036fda2165 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.878612] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.878904] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.879079] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.879191] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.880378] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca99b1a6-3702-4011-942b-06036fda2165 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.880534] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.881630] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea77fa15-d004-4f6d-bea0-02027383b034 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.881630] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea77fa15-d004-4f6d-bea0-02027383b034" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.881630] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea77fa15-d004-4f6d-bea0-02027383b034" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.881909] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea77fa15-d004-4f6d-bea0-02027383b034" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.881909] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea77fa15-d004-4f6d-bea0-02027383b034',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.959411] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.959411] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.959411] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.959609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.959640] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.959742] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e is going to be updated. [ 750.995038] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.995916] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.995916] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.995916] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.995916] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.005630] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e in Status: IN_PROGRESS for 2s [ 751.384478] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca99b1a6-3702-4011-942b-06036fda2165 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.384809] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.386208] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea77fa15-d004-4f6d-bea0-02027383b034 with status ACTIVE [ 751.386418] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.386543] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.386608] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.386813] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.386902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.387092] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.387188] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.387250] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.387388] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.387459] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.387646] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.387717] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.387763] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.387895] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.387991] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.388048] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea77fa15-d004-4f6d-bea0-02027383b034 is going to be updated. [ 751.411099] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.411300] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.412030] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.412030] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.412030] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.412030] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea77fa15-d004-4f6d-bea0-02027383b034" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.384097] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b56f5230-554e-48f1-aef4-fcf2593b50d3 in Status: SUCCESS [ 752.384444] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b56f5230-554e-48f1-aef4-fcf2593b50d3 deletion is rescheduled due to dependency. [ 752.384634] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.739889] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: SUCCESS [ 752.740156] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.740484] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.740714] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.740899] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.741141] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.741194] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.741491] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.741491] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.741491] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.853957] env[65783]: INFO networking_nsxv3.common.synchronization [req-dd0c98f5-ca8b-4103-8b8f-378e6bed9c5b req-e8190a9b-655b-483b-979b-1a94268d4130 tempest-ServersWithSpecificFlavorTestJSON-767212478 tempest-ServersWithSpecificFlavorTestJSON-767212478-project-member] Enqueued Resource ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 with Priority: HIGHEST for action security_group_members [ 752.855458] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 with Priority: HIGHEST for action security_group_members [ 752.856291] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e588ff7c-d45a-4b75-823e-f219eeb5e814 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.856291] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.856291] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.856820] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.856820] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.856820] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.856820] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.857047] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.857047] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.857146] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e588ff7c-d45a-4b75-823e-f219eeb5e814',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.019701] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e in Status: SUCCESS [ 753.021398] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.244144] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.361437] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.361593] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.361635] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.362137] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.362137] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.362251] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.362303] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.362358] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.363065] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.363398] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.363628] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 is going to be updated. [ 753.395091] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.395091] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.395091] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.395091] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.395546] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.405291] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 in Status: IN_PROGRESS for 2s [ 753.747648] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.252018] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.252248] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.252321] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.252574] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.252667] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.252772] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca99b1a6-3702-4011-942b-06036fda2165 is going to be updated. [ 754.263995] env[65783]: INFO networking_nsxv3.common.synchronization [req-c6a19a5d-12ef-4721-b9b4-734fcd971af3 req-9bc1b352-95e9-42ee-af7c-52c99bf80c75 tempest-ServerRescueNegativeTestJSON-1644419569 tempest-ServerRescueNegativeTestJSON-1644419569-project-member] Enqueued Resource ID: 0010338f-67e3-417c-be88-4e0a85ad75aa with Priority: HIGHEST for action security_group_members [ 754.264680] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0010338f-67e3-417c-be88-4e0a85ad75aa with Priority: HIGHEST for action security_group_members [ 754.265000] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-0010338f-67e3-417c-be88-4e0a85ad75aa taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.265157] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.265209] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.265448] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.265598] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.265694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.265780] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.265980] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.266139] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.266181] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0010338f-67e3-417c-be88-4e0a85ad75aa',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.295140] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.295140] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.295337] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.295475] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.295625] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.306925] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: IN_PROGRESS for 2s [ 754.701458] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-863 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.701766] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-863" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.701766] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-863" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.703688] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-863" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.703688] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.703974] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.703974] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.705284] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.705468] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.705674] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 754.705786] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 754.705992] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 754.706065] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 754.706230] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 754.706301] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 754.706499] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 754.730096] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 754.730096] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 754.730518] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 754.730785] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-863" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.731393] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-f116c9d8-4c98-4af9-8747-0c585d99d738 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.731393] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-f116c9d8-4c98-4af9-8747-0c585d99d738" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.731568] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-f116c9d8-4c98-4af9-8747-0c585d99d738" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.732625] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-f116c9d8-4c98-4af9-8747-0c585d99d738" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.732625] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f116c9d8-4c98-4af9-8747-0c585d99d738',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.770239] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.770239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.770239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.770418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.770418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.772630] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.772815] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.772815] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.773039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.773128] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.773221] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0010338f-67e3-417c-be88-4e0a85ad75aa already deleted. [ 754.773302] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.235845] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.236155] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.236274] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.236570] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.236975] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.236975] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port f116c9d8-4c98-4af9-8747-0c585d99d738 not found, creating... [ 755.237084] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.237211] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.237305] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.238620] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.238620] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.238620] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.238620] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.238620] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.238620] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.238883] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.238883] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: f116c9d8-4c98-4af9-8747-0c585d99d738 is going to be created. [ 755.264156] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.264382] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.264499] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.264853] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.265076] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.265290] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-f116c9d8-4c98-4af9-8747-0c585d99d738" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.419649] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 in Status: SUCCESS [ 755.420629] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 deletion is rescheduled due to dependency. [ 755.420629] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.869542] env[65783]: INFO networking_nsxv3.common.synchronization [req-9dc7c376-1182-4c1d-b0f4-16c0e060fb05 req-9b5f0b33-9db3-42c2-b7bb-ea8a4dd8be2b tempest-VolumesAssistedSnapshotsTest-1577585050 tempest-VolumesAssistedSnapshotsTest-1577585050-project-member] Enqueued Resource ID: 527a6015-4311-4050-9945-7b4c6e602f59 with Priority: HIGHEST for action security_group_members [ 755.870183] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527a6015-4311-4050-9945-7b4c6e602f59 with Priority: HIGHEST for action security_group_members [ 755.871110] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-527a6015-4311-4050-9945-7b4c6e602f59 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.871244] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.871291] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.871538] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.871727] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.871881] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.871950] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.872187] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.872296] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.872416] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('527a6015-4311-4050-9945-7b4c6e602f59',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.007294] env[65783]: INFO networking_nsxv3.common.synchronization [req-c6a19a5d-12ef-4721-b9b4-734fcd971af3 req-7a3a25f8-492c-42cd-a5e5-09da748deabe service nova] Enqueued Resource ID: 0010338f-67e3-417c-be88-4e0a85ad75aa with Priority: HIGHEST for action security_group_rules [ 756.008056] env[65783]: INFO networking_nsxv3.common.synchronization [req-c6a19a5d-12ef-4721-b9b4-734fcd971af3 req-7a3a25f8-492c-42cd-a5e5-09da748deabe service nova] Enqueued Resource ID: 0010338f-67e3-417c-be88-4e0a85ad75aa with Priority: HIGHEST for action security_group_members [ 756.008056] env[65783]: INFO networking_nsxv3.common.synchronization [req-c6a19a5d-12ef-4721-b9b4-734fcd971af3 req-7a3a25f8-492c-42cd-a5e5-09da748deabe service nova] Enqueued Resource ID: f116c9d8-4c98-4af9-8747-0c585d99d738 with Priority: HIGHEST for action port [ 756.008220] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0010338f-67e3-417c-be88-4e0a85ad75aa with Priority: HIGHEST for action security_group_rules [ 756.009035] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0010338f-67e3-417c-be88-4e0a85ad75aa with Priority: HIGHEST for action security_group_members [ 756.009035] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f116c9d8-4c98-4af9-8747-0c585d99d738 with Priority: HIGHEST for action port [ 756.009035] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0010338f-67e3-417c-be88-4e0a85ad75aa taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.009035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.009035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.009284] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.010026] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0010338f-67e3-417c-be88-4e0a85ad75aa',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.010574] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-0010338f-67e3-417c-be88-4e0a85ad75aa taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.010695] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.010773] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.010957] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.011200] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.012089] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.012089] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.012089] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.012089] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.012274] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0010338f-67e3-417c-be88-4e0a85ad75aa',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.013270] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-f116c9d8-4c98-4af9-8747-0c585d99d738 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.013444] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f116c9d8-4c98-4af9-8747-0c585d99d738" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.013551] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f116c9d8-4c98-4af9-8747-0c585d99d738" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.013781] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f116c9d8-4c98-4af9-8747-0c585d99d738" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.013913] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f116c9d8-4c98-4af9-8747-0c585d99d738',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.319246] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: SUCCESS [ 756.319246] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.319246] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.320336] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.320336] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.320336] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.320336] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.320336] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.320336] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.320336] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.320336] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.375175] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.375336] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.375405] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.375630] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.375717] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.375912] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.376049] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.376099] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.376230] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.376309] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.376395] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 527a6015-4311-4050-9945-7b4c6e602f59 is going to be updated. [ 756.407113] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.407113] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.407113] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.407113] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.407113] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.417338] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527a6015-4311-4050-9945-7b4c6e602f59 in Status: IN_PROGRESS for 2s [ 756.516635] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-0010338f-67e3-417c-be88-4e0a85ad75aa taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.516790] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.516959] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f116c9d8-4c98-4af9-8747-0c585d99d738 with status ACTIVE [ 756.517139] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.517248] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.517312] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.517527] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.517616] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.517779] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.517877] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.517925] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.518084] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.518160] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.518339] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.518432] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.518492] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.518645] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.518690] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.518773] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f116c9d8-4c98-4af9-8747-0c585d99d738 is going to be updated. [ 756.519934] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0010338f-67e3-417c-be88-4e0a85ad75aa',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.542509] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.543625] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.543625] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.543625] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.543625] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.543834] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f116c9d8-4c98-4af9-8747-0c585d99d738" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.823723] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca99b1a6-3702-4011-942b-06036fda2165 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.824218] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.824407] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.824688] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.826411] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.826548] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.826592] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.826773] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.826975] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.826975] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.827119] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca99b1a6-3702-4011-942b-06036fda2165 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.827207] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.827270] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.827414] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.827554] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.827645] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.827705] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.827838] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.827912] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.827988] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.828402] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.022632] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0010338f-67e3-417c-be88-4e0a85ad75aa',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.332938] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca99b1a6-3702-4011-942b-06036fda2165: rpc.has_security_group_logging(os_id): False [ 757.352783] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.352996] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.354086] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.354086] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.354086] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.354086] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.354086] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.354086] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.354086] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.354365] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.354365] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.354445] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.354510] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.354918] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.355045] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.355253] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.355437] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.355562] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.355726] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.355804] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.355889] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca99b1a6-3702-4011-942b-06036fda2165 is going to be updated. [ 757.363567] env[65783]: INFO networking_nsxv3.common.synchronization [req-a1fc31d7-6c82-47e1-99b6-7d911353649c req-1f6114e7-5cbe-405a-add2-ada7795cd0c5 tempest-ServerMetadataTestJSON-2105857083 tempest-ServerMetadataTestJSON-2105857083-project-member] Enqueued Resource ID: 7998a549-f70e-4b58-992e-5c5ab6652711 with Priority: HIGHEST for action security_group_members [ 757.364314] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7998a549-f70e-4b58-992e-5c5ab6652711 with Priority: HIGHEST for action security_group_members [ 757.364413] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-7998a549-f70e-4b58-992e-5c5ab6652711 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.364520] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7998a549-f70e-4b58-992e-5c5ab6652711" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.364585] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7998a549-f70e-4b58-992e-5c5ab6652711" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.364782] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7998a549-f70e-4b58-992e-5c5ab6652711" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.364950] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.365031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.365094] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.365221] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.365325] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.365418] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7998a549-f70e-4b58-992e-5c5ab6652711',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.419925] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.420080] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.420153] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.420360] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.420499] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.437656] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: IN_PROGRESS for 2s [ 757.447016] env[65783]: INFO networking_nsxv3.common.synchronization [req-2d63faf2-579b-4ed0-b28d-213d0b47bd3f req-d30f26a1-c349-494e-9f95-5d6e0626ec94 tempest-ServerActionsV293TestJSON-1619444112 tempest-ServerActionsV293TestJSON-1619444112-project-member] Enqueued Resource ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 with Priority: HIGHEST for action security_group_members [ 757.447545] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 with Priority: HIGHEST for action security_group_members [ 757.447842] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-d62819d6-c7c5-47a8-a028-a438cb9528b5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.448141] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.448250] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.448563] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.448732] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.448839] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.448897] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.449088] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.449177] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.449261] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d62819d6-c7c5-47a8-a028-a438cb9528b5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.526723] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.526903] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.526974] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.527364] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.527473] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.527574] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0010338f-67e3-417c-be88-4e0a85ad75aa is going to be created. [ 757.572950] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.573121] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.573197] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.573405] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.573569] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.584961] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0010338f-67e3-417c-be88-4e0a85ad75aa in Status: UNINITIALIZED for 2s [ 757.821651] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-389 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.825179] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-389" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.825179] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-389" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.825179] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-389" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.825179] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.825179] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.826603] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.826962] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.828525] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.828671] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 757.828760] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 757.828932] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 757.829024] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 757.829324] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 757.829324] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 757.829424] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 757.850917] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 757.850975] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 757.851805] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 757.851805] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-389" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.852028] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-82d30609-6b15-4172-aef8-f9afa1ed72e9 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.852129] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-82d30609-6b15-4172-aef8-f9afa1ed72e9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.852210] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-82d30609-6b15-4172-aef8-f9afa1ed72e9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.852519] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-82d30609-6b15-4172-aef8-f9afa1ed72e9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.852670] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82d30609-6b15-4172-aef8-f9afa1ed72e9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.871139] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.871139] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.871139] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.871454] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.871704] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.871819] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.871943] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.872043] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.872278] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.872362] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.872472] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7998a549-f70e-4b58-992e-5c5ab6652711 is going to be updated. [ 757.927916] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.927916] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.927916] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.929885] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.929885] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.947060] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7998a549-f70e-4b58-992e-5c5ab6652711 in Status: IN_PROGRESS for 2s [ 757.953370] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.953370] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.953370] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.953370] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.953370] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.953370] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.953370] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.953370] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.953370] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.953370] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.953370] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 already deleted. [ 757.953370] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.189512] env[65783]: INFO networking_nsxv3.common.synchronization [req-9a00bc47-3a42-4254-8192-202c38fb8420 req-a6b0bcef-d0e3-4da9-8a46-17fb43365605 tempest-InstanceActionsTestJSON-1234363326 tempest-InstanceActionsTestJSON-1234363326-project-member] Enqueued Resource ID: b4233009-fbd8-4936-abda-bc37e3d37b55 with Priority: HIGHEST for action security_group_members [ 758.190497] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4233009-fbd8-4936-abda-bc37e3d37b55 with Priority: HIGHEST for action security_group_members [ 758.190497] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4233009-fbd8-4936-abda-bc37e3d37b55 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.190680] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.190680] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.190860] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.191100] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.191487] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.191487] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.191487] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.191748] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.191748] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4233009-fbd8-4936-abda-bc37e3d37b55',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.356139] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.356139] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.356139] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.356494] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.356536] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.356703] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 82d30609-6b15-4172-aef8-f9afa1ed72e9 not found, creating... [ 758.357024] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.357165] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.357276] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.357520] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.357681] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.357957] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.358154] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.358266] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.358496] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.358633] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.358767] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 82d30609-6b15-4172-aef8-f9afa1ed72e9 is going to be created. [ 758.383338] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.383811] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.384071] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.384486] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.384842] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.385483] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-82d30609-6b15-4172-aef8-f9afa1ed72e9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.427352] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 527a6015-4311-4050-9945-7b4c6e602f59 in Status: SUCCESS [ 758.427563] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 527a6015-4311-4050-9945-7b4c6e602f59 deletion is rescheduled due to dependency. [ 758.427682] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.695172] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.695172] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.695172] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.695807] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.695921] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.696261] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.696387] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.696453] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.696628] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.696711] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.696858] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4233009-fbd8-4936-abda-bc37e3d37b55 is going to be updated. [ 758.738387] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.738628] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.738738] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.739828] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.739828] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.751507] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4233009-fbd8-4936-abda-bc37e3d37b55 in Status: IN_PROGRESS for 2s [ 759.137689] env[65783]: INFO networking_nsxv3.common.synchronization [req-2d63faf2-579b-4ed0-b28d-213d0b47bd3f req-db9a416f-6495-428c-8819-29fdedaf0fc4 service nova] Enqueued Resource ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 with Priority: HIGHEST for action security_group_rules [ 759.137941] env[65783]: INFO networking_nsxv3.common.synchronization [req-2d63faf2-579b-4ed0-b28d-213d0b47bd3f req-db9a416f-6495-428c-8819-29fdedaf0fc4 service nova] Enqueued Resource ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 with Priority: HIGHEST for action security_group_members [ 759.138784] env[65783]: INFO networking_nsxv3.common.synchronization [req-2d63faf2-579b-4ed0-b28d-213d0b47bd3f req-db9a416f-6495-428c-8819-29fdedaf0fc4 service nova] Enqueued Resource ID: 82d30609-6b15-4172-aef8-f9afa1ed72e9 with Priority: HIGHEST for action port [ 759.138784] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 with Priority: HIGHEST for action security_group_rules [ 759.138784] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 with Priority: HIGHEST for action security_group_members [ 759.139302] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82d30609-6b15-4172-aef8-f9afa1ed72e9 with Priority: HIGHEST for action port [ 759.139686] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d62819d6-c7c5-47a8-a028-a438cb9528b5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.139764] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.139803] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.139986] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.140137] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d62819d6-c7c5-47a8-a028-a438cb9528b5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.141031] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-d62819d6-c7c5-47a8-a028-a438cb9528b5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.141159] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.141317] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.141869] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.141869] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.141869] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.141869] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.141869] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.142205] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.142205] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d62819d6-c7c5-47a8-a028-a438cb9528b5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.142808] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-82d30609-6b15-4172-aef8-f9afa1ed72e9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.143137] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82d30609-6b15-4172-aef8-f9afa1ed72e9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.144078] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82d30609-6b15-4172-aef8-f9afa1ed72e9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.144078] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82d30609-6b15-4172-aef8-f9afa1ed72e9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.144166] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82d30609-6b15-4172-aef8-f9afa1ed72e9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.458939] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: SUCCESS [ 759.460532] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.595734] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0010338f-67e3-417c-be88-4e0a85ad75aa in Status: SUCCESS [ 759.596148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.596760] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.596858] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.597630] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.597630] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.597630] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.597630] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.597871] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.597960] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.598110] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0010338f-67e3-417c-be88-4e0a85ad75aa',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.646247] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-d62819d6-c7c5-47a8-a028-a438cb9528b5 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.647035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.647035] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d62819d6-c7c5-47a8-a028-a438cb9528b5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.648146] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82d30609-6b15-4172-aef8-f9afa1ed72e9 with status ACTIVE [ 759.648252] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.648378] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.648427] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.648881] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.648881] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.648881] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.649090] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.649090] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.649183] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.649257] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.649451] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.649588] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.649662] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.649808] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.649888] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.650040] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82d30609-6b15-4172-aef8-f9afa1ed72e9 is going to be updated. [ 759.673806] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.673948] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.673948] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.676045] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.676045] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.676045] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82d30609-6b15-4172-aef8-f9afa1ed72e9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.035311] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7998a549-f70e-4b58-992e-5c5ab6652711 in Status: SUCCESS [ 760.035511] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7998a549-f70e-4b58-992e-5c5ab6652711 deletion is rescheduled due to dependency. [ 760.035638] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7998a549-f70e-4b58-992e-5c5ab6652711" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.103482] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-0010338f-67e3-417c-be88-4e0a85ad75aa taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.103677] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.103775] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.103977] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.104175] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.104271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.104323] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.104512] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.104549] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.104654] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.104787] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-0010338f-67e3-417c-be88-4e0a85ad75aa taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.104880] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.104933] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.105102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.105262] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.105350] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.105420] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.105565] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.105644] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.105718] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.105810] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0010338f-67e3-417c-be88-4e0a85ad75aa',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.148810] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d62819d6-c7c5-47a8-a028-a438cb9528b5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.338093] env[65783]: INFO networking_nsxv3.common.synchronization [req-6fb996bb-b0c3-41fa-87d3-160a6e6b3722 req-5b4e6bf7-c268-4724-8cb8-9623c717703e tempest-ServerRescueNegativeTestJSON-1644419569 tempest-ServerRescueNegativeTestJSON-1644419569-project-member] Enqueued Resource ID: 0010338f-67e3-417c-be88-4e0a85ad75aa with Priority: HIGHEST for action security_group_members [ 760.338633] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0010338f-67e3-417c-be88-4e0a85ad75aa with Priority: HIGHEST for action security_group_members [ 760.339112] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-0010338f-67e3-417c-be88-4e0a85ad75aa taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.339246] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.339315] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.339515] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.339674] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.339852] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.339912] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.340085] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.340170] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.340429] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0010338f-67e3-417c-be88-4e0a85ad75aa',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.612548] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0010338f-67e3-417c-be88-4e0a85ad75aa: rpc.has_security_group_logging(os_id): False [ 760.630738] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.630992] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.631217] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.631532] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.631693] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.631997] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.632254] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.632374] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.632625] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.632765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.633082] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.633252] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.633371] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.633605] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.633745] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.634071] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.634245] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.634363] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.634604] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.634741] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.634878] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0010338f-67e3-417c-be88-4e0a85ad75aa is going to be created. [ 760.651143] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.651587] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.651742] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.652136] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.652293] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.652462] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 is going to be created. [ 760.677089] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.677089] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.677089] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.677575] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.677575] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.691203] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 in Status: UNINITIALIZED for 2s [ 760.694285] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-863 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.694285] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-863" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.694285] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-863" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.695279] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-863" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.695713] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.695979] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.696172] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.696459] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.696651] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.696930] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 760.697100] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 760.697274] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 760.697417] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 760.697578] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 760.697734] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 760.697919] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 760.715209] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.715209] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.715209] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.715209] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.715428] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.717654] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 760.717797] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 760.719146] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 760.719146] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-863" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.719146] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-2af7b9f3-396f-41c3-954c-e947acc02fd1 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.719146] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-2af7b9f3-396f-41c3-954c-e947acc02fd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.719146] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-2af7b9f3-396f-41c3-954c-e947acc02fd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.719146] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-2af7b9f3-396f-41c3-954c-e947acc02fd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.719146] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2af7b9f3-396f-41c3-954c-e947acc02fd1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.735627] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0010338f-67e3-417c-be88-4e0a85ad75aa in Status: IN_PROGRESS for 2s [ 760.772026] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4233009-fbd8-4936-abda-bc37e3d37b55 in Status: SUCCESS [ 760.772225] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4233009-fbd8-4936-abda-bc37e3d37b55 deletion is rescheduled due to dependency. [ 760.772365] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.845033] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0010338f-67e3-417c-be88-4e0a85ad75aa',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.221984] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.222125] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.222353] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.222633] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.222816] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.223021] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 2af7b9f3-396f-41c3-954c-e947acc02fd1 not found, creating... [ 761.223382] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.223579] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.223720] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.223980] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.224187] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.224478] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.224631] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.224739] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.224942] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.225075] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.225210] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 2af7b9f3-396f-41c3-954c-e947acc02fd1 is going to be created. [ 761.253151] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.253451] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.253587] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.253944] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.254315] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.254583] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-2af7b9f3-396f-41c3-954c-e947acc02fd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.347012] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0010338f-67e3-417c-be88-4e0a85ad75aa',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.850564] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.851134] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.851134] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.851360] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.851456] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.851593] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0010338f-67e3-417c-be88-4e0a85ad75aa is going to be updated. [ 761.885185] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.885426] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.885528] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.885665] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.885814] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.896247] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0010338f-67e3-417c-be88-4e0a85ad75aa in Status: IN_PROGRESS for 2s [ 762.090202] env[65783]: INFO networking_nsxv3.common.synchronization [req-6fb996bb-b0c3-41fa-87d3-160a6e6b3722 req-6aecd4a4-8027-473b-9831-b662654f84d2 service nova] Enqueued Resource ID: 0010338f-67e3-417c-be88-4e0a85ad75aa with Priority: HIGHEST for action security_group_rules [ 762.090805] env[65783]: INFO networking_nsxv3.common.synchronization [req-6fb996bb-b0c3-41fa-87d3-160a6e6b3722 req-6aecd4a4-8027-473b-9831-b662654f84d2 service nova] Enqueued Resource ID: 0010338f-67e3-417c-be88-4e0a85ad75aa with Priority: HIGHEST for action security_group_members [ 762.090805] env[65783]: INFO networking_nsxv3.common.synchronization [req-6fb996bb-b0c3-41fa-87d3-160a6e6b3722 req-6aecd4a4-8027-473b-9831-b662654f84d2 service nova] Enqueued Resource ID: 2af7b9f3-396f-41c3-954c-e947acc02fd1 with Priority: HIGHEST for action port [ 762.091615] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0010338f-67e3-417c-be88-4e0a85ad75aa with Priority: HIGHEST for action security_group_rules [ 762.091807] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0010338f-67e3-417c-be88-4e0a85ad75aa with Priority: HIGHEST for action security_group_members [ 762.091907] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2af7b9f3-396f-41c3-954c-e947acc02fd1 with Priority: HIGHEST for action port [ 762.092325] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0010338f-67e3-417c-be88-4e0a85ad75aa taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.092533] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.092717] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-0010338f-67e3-417c-be88-4e0a85ad75aa taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.092806] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.092980] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-2af7b9f3-396f-41c3-954c-e947acc02fd1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.093108] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2af7b9f3-396f-41c3-954c-e947acc02fd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.093156] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2af7b9f3-396f-41c3-954c-e947acc02fd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.093353] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2af7b9f3-396f-41c3-954c-e947acc02fd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.093450] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2af7b9f3-396f-41c3-954c-e947acc02fd1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.596224] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2af7b9f3-396f-41c3-954c-e947acc02fd1 with status ACTIVE [ 762.596224] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.596412] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.596412] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.596649] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.596830] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.597062] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.597182] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.597284] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.597384] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.597462] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.597687] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.597769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.597809] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.597916] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.597988] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.598086] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2af7b9f3-396f-41c3-954c-e947acc02fd1 is going to be updated. [ 762.632179] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.632414] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.632552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.632880] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.633106] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.633337] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2af7b9f3-396f-41c3-954c-e947acc02fd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.724655] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 in Status: SUCCESS [ 762.724655] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.724655] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.724775] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.724939] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.725074] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.725147] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.725284] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.725384] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.725465] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.725555] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d62819d6-c7c5-47a8-a028-a438cb9528b5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.755800] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0010338f-67e3-417c-be88-4e0a85ad75aa in Status: SUCCESS [ 762.756082] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.756648] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.756882] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.756971] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0010338f-67e3-417c-be88-4e0a85ad75aa',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.229256] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d62819d6-c7c5-47a8-a028-a438cb9528b5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.259346] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-0010338f-67e3-417c-be88-4e0a85ad75aa taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.259429] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.291034] env[65783]: INFO networking_nsxv3.common.synchronization [req-e179f5e1-1240-45b3-9cc2-d17540510aaa req-2c55cdd3-a76b-4605-826c-73807f02f3f6 tempest-ServerDiskConfigTestJSON-664757069 tempest-ServerDiskConfigTestJSON-664757069-project-member] Enqueued Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 763.291337] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 763.291673] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.292266] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.292266] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.292266] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.292266] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.293083] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.293083] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.293083] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.293083] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.293083] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.695689] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-965 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.696341] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-965" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.696605] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-965" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.697060] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-965" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.697496] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.697747] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.697928] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.698287] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.698513] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.698798] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 763.698961] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 763.699184] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 763.699406] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 763.699650] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 763.699909] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 763.700225] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 763.726120] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 763.726545] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 763.726545] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 763.726928] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-965" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.727375] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-9e5e0e29-c770-41e3-9766-2be8e6f3dc96 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.727939] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-9e5e0e29-c770-41e3-9766-2be8e6f3dc96" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.728128] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-9e5e0e29-c770-41e3-9766-2be8e6f3dc96" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.728593] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-9e5e0e29-c770-41e3-9766-2be8e6f3dc96" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.729238] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e5e0e29-c770-41e3-9766-2be8e6f3dc96',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.731760] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d62819d6-c7c5-47a8-a028-a438cb9528b5: rpc.has_security_group_logging(os_id): False [ 763.757028] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.757028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.757028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.757028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.757028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.757028] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.757028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.757028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.757454] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.757454] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.757454] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 is going to be created. [ 763.795211] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.795211] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.795211] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.795211] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.795211] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.795669] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.795669] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.795669] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.795669] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.795822] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.795822] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 is going to be updated. [ 763.828299] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.828299] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.828299] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.828617] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.828617] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.836359] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.836533] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.837511] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.837511] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.837511] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.839810] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: IN_PROGRESS for 2s [ 763.848093] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 in Status: IN_PROGRESS for 2s [ 763.932997] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0010338f-67e3-417c-be88-4e0a85ad75aa in Status: SUCCESS [ 763.934454] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.934454] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.934454] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.935280] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.936209] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.936282] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.936555] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.936673] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.936793] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0010338f-67e3-417c-be88-4e0a85ad75aa',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.231611] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.232218] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.232415] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.232754] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.232901] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.233089] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 9e5e0e29-c770-41e3-9766-2be8e6f3dc96 not found, creating... [ 764.233531] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.233740] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.233869] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.234136] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.234294] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.234629] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.234795] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.234923] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.235178] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.235374] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.235481] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 9e5e0e29-c770-41e3-9766-2be8e6f3dc96 is going to be created. [ 764.264533] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.264781] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.264885] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.265297] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.265540] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.265770] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-9e5e0e29-c770-41e3-9766-2be8e6f3dc96" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.440143] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0010338f-67e3-417c-be88-4e0a85ad75aa',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.946360] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0010338f-67e3-417c-be88-4e0a85ad75aa',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.051047] env[65783]: INFO networking_nsxv3.common.synchronization [req-e179f5e1-1240-45b3-9cc2-d17540510aaa req-27096e47-1b78-4048-91cb-5a9ea004ac85 service nova] Enqueued Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_rules [ 765.051394] env[65783]: INFO networking_nsxv3.common.synchronization [req-e179f5e1-1240-45b3-9cc2-d17540510aaa req-27096e47-1b78-4048-91cb-5a9ea004ac85 service nova] Enqueued Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 765.051544] env[65783]: INFO networking_nsxv3.common.synchronization [req-e179f5e1-1240-45b3-9cc2-d17540510aaa req-27096e47-1b78-4048-91cb-5a9ea004ac85 service nova] Enqueued Resource ID: 9e5e0e29-c770-41e3-9766-2be8e6f3dc96 with Priority: HIGHEST for action port [ 765.052198] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_rules [ 765.052348] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 765.052506] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5e0e29-c770-41e3-9766-2be8e6f3dc96 with Priority: HIGHEST for action port [ 765.052835] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.052961] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.053063] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.053717] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.053815] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.054937] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.055059] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.055314] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e5e0e29-c770-41e3-9766-2be8e6f3dc96 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.055487] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e5e0e29-c770-41e3-9766-2be8e6f3dc96" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.055586] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e5e0e29-c770-41e3-9766-2be8e6f3dc96" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.055802] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e5e0e29-c770-41e3-9766-2be8e6f3dc96" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.055887] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e5e0e29-c770-41e3-9766-2be8e6f3dc96',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.448582] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.448974] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.448974] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.449096] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.449189] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.449291] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0010338f-67e3-417c-be88-4e0a85ad75aa is going to be updated. [ 765.491543] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.491543] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.491543] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.491838] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.491838] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.503750] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0010338f-67e3-417c-be88-4e0a85ad75aa in Status: IN_PROGRESS for 2s [ 765.559350] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e5e0e29-c770-41e3-9766-2be8e6f3dc96 with status ACTIVE [ 765.560031] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.560031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.560031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.560394] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.560394] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.560486] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.560612] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.560700] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.560862] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.560942] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.561188] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.561299] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.561346] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.561494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.561570] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.561658] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e5e0e29-c770-41e3-9766-2be8e6f3dc96 is going to be updated. [ 765.562840] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.562969] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.584790] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.584927] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.584998] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.585618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.585618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.585618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e5e0e29-c770-41e3-9766-2be8e6f3dc96" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.851426] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: SUCCESS [ 765.851622] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 deletion is rescheduled due to dependency. [ 765.851769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.851903] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.852304] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.852483] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.852674] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.852733] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.852884] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.852985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.853139] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.860830] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 in Status: SUCCESS [ 765.861135] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.355403] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.664329] env[65783]: INFO networking_nsxv3.common.synchronization [None req-e6111446-9c5d-4ec5-8e3f-6459dc600361 tempest-ServerActionsTestOtherA-298845163 tempest-ServerActionsTestOtherA-298845163-project-member] Enqueued Resource ID: de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb with Priority: HIGHEST for action security_group_rules [ 766.664897] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb with Priority: HIGHEST for action security_group_rules [ 766.665219] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.665345] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.665410] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.665695] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.665782] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.766203] env[65783]: INFO networking_nsxv3.common.synchronization [None req-a840a961-9062-48f1-871f-7ea8f563e38e tempest-ServerActionsTestOtherA-298845163 tempest-ServerActionsTestOtherA-298845163-project-member] Enqueued Resource ID: de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb with Priority: HIGHEST for action security_group_rules [ 766.767143] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb with Priority: HIGHEST for action security_group_rules [ 766.767642] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.768390] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.858521] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.192726] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.193054] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.193157] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.193976] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.193976] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.193976] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb already deleted. [ 767.193976] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.196523] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.196920] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.197152] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.361729] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.361870] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.361961] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.362292] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.362409] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.363039] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 is going to be updated. [ 767.396097] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.396097] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.396097] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.396097] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.396097] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.406023] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: IN_PROGRESS for 2s [ 767.516753] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0010338f-67e3-417c-be88-4e0a85ad75aa in Status: SUCCESS [ 767.517108] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.517489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.517894] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.518277] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.518442] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.518562] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.519024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.519024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.519327] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.519503] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0010338f-67e3-417c-be88-4e0a85ad75aa',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.726595] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.727031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.727031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.727615] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.727615] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.727615] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb already deleted. [ 767.727615] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.023022] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-0010338f-67e3-417c-be88-4e0a85ad75aa taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.023790] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.023790] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.023790] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.023790] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.024119] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.025042] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.025042] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.025042] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.025042] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.025042] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-0010338f-67e3-417c-be88-4e0a85ad75aa taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.025042] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.025042] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.025042] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.025527] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.025642] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.025689] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.025993] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.026119] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.026533] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.027215] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0010338f-67e3-417c-be88-4e0a85ad75aa',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.330753] env[65783]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 768.330889] env[65783]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] NSXv3 Agent Agent loop - iteration:1 started [ 768.532359] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0010338f-67e3-417c-be88-4e0a85ad75aa: rpc.has_security_group_logging(os_id): False [ 768.554055] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.555373] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.555373] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.555373] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.555717] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.555947] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.556638] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.556638] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.556638] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.556638] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.556995] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.557136] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.557199] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.557344] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.557418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.557622] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.557799] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.557799] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.557917] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.557964] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.558211] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0010338f-67e3-417c-be88-4e0a85ad75aa is going to be updated. [ 768.638553] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.638723] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.638777] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.639147] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.639147] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.671029] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0010338f-67e3-417c-be88-4e0a85ad75aa in Status: IN_PROGRESS for 2s [ 769.421412] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: SUCCESS [ 769.421777] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.422815] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.422815] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.422815] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.422815] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.422815] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.423095] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.423095] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.423181] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.423274] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.926175] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.926417] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.926517] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.926784] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.927071] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.927286] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.927375] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.927612] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.928022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.928022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.928150] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.928281] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.928347] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.928516] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.928661] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.928754] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.928814] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.928962] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.929117] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.929232] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.929362] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.431880] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9943d881-28bf-4885-906c-d360f9c2c3e7: rpc.has_security_group_logging(os_id): False [ 770.456685] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.456832] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.456904] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.457166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.457264] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.457462] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.457604] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.457665] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.457838] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.458099] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.458338] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.458441] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.458504] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.458652] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.458728] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.458988] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.459151] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.459212] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.459331] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.459502] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.459653] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 is going to be updated. [ 770.534962] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.535066] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.535066] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.535269] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.535553] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.557549] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: IN_PROGRESS for 2s [ 770.687085] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0010338f-67e3-417c-be88-4e0a85ad75aa in Status: SUCCESS [ 770.687396] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.029098] env[65783]: INFO networking_nsxv3.common.synchronization [req-df19d71d-b322-4b8b-a74e-4efdfcb3b970 req-cf16a87e-6dfa-46fe-a51c-196dc8190513 tempest-ServersTestBootFromVolume-1696516378 tempest-ServersTestBootFromVolume-1696516378-project-member] Enqueued Resource ID: 3654b92f-abc1-46ca-b6d3-5854c70c886e with Priority: HIGHEST for action security_group_members [ 771.029673] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3654b92f-abc1-46ca-b6d3-5854c70c886e with Priority: HIGHEST for action security_group_members [ 771.029975] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3654b92f-abc1-46ca-b6d3-5854c70c886e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.030376] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.030376] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.030520] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.030662] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.030776] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.030862] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.030975] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.031054] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.031277] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3654b92f-abc1-46ca-b6d3-5854c70c886e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.533927] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.534302] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.534344] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.534562] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.534657] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.534862] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.534962] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.535033] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.535185] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.535262] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.535346] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3654b92f-abc1-46ca-b6d3-5854c70c886e is going to be updated. [ 771.568217] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.568217] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.568217] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.568217] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.568217] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.577401] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3654b92f-abc1-46ca-b6d3-5854c70c886e in Status: IN_PROGRESS for 2s [ 771.725572] env[65783]: INFO networking_nsxv3.common.synchronization [req-c939509b-57e7-4e7e-80d7-40ea918b758f req-2c746caa-83b3-4305-9641-b59febf94599 tempest-ServersAdminNegativeTestJSON-2089691366 tempest-ServersAdminNegativeTestJSON-2089691366-project-member] Enqueued Resource ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c with Priority: HIGHEST for action security_group_members [ 771.727097] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c with Priority: HIGHEST for action security_group_members [ 771.727097] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5516de4-7ca8-423d-ae28-4654dc2ae29c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.727097] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.727097] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.727097] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.727097] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.727097] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.727097] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.727385] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.727385] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.727442] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5516de4-7ca8-423d-ae28-4654dc2ae29c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.982529] env[65783]: INFO networking_nsxv3.common.synchronization [req-8da413eb-908b-43c8-a93b-3c403e2f3040 req-b9f3b341-a23d-4679-addd-d4f0e7752123 tempest-ImagesTestJSON-433702528 tempest-ImagesTestJSON-433702528-project-member] Enqueued Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 771.983753] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 771.983753] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.983753] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.983970] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.984087] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.984389] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.984389] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.984389] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.984542] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.984542] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.984617] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.158838] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-251 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.159054] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.159183] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.159456] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.159823] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.160009] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.160129] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.160377] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.160542] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.160744] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 772.160849] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 772.160951] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 772.161065] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 772.161225] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 772.161339] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 772.161486] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 772.184903] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 772.184903] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 772.184903] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 772.184903] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.185189] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-3a66ab74-5f68-4ab5-939e-de3cc3e69db2 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.185189] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-3a66ab74-5f68-4ab5-939e-de3cc3e69db2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.185317] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-3a66ab74-5f68-4ab5-939e-de3cc3e69db2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.185627] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-3a66ab74-5f68-4ab5-939e-de3cc3e69db2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.185757] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a66ab74-5f68-4ab5-939e-de3cc3e69db2',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.228876] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5516de4-7ca8-423d-ae28-4654dc2ae29c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.488146] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.488375] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.488479] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.488666] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.488759] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.489013] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.489097] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.489189] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.489264] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.489437] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.489501] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd942bf-b305-4707-8084-1ac6b135c741 is going to be updated. [ 772.520600] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.520750] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.520805] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.521015] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.521219] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.531644] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: IN_PROGRESS for 2s [ 772.575502] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: SUCCESS [ 772.575793] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.688224] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.688733] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.688988] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.689293] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.689467] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.689617] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 3a66ab74-5f68-4ab5-939e-de3cc3e69db2 not found, creating... [ 772.689890] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.690059] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.690160] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.690378] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.690500] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.690783] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.690939] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.691056] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.691265] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.691383] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.691509] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 3a66ab74-5f68-4ab5-939e-de3cc3e69db2 is going to be created. [ 772.714603] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.714800] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.714864] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.715176] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.715401] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.715630] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-3a66ab74-5f68-4ab5-939e-de3cc3e69db2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.731512] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5516de4-7ca8-423d-ae28-4654dc2ae29c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.234911] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.235180] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.235292] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.236372] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.236372] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.236372] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c is going to be updated. [ 773.278758] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.278969] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.278969] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.279206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.279371] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.295638] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c in Status: IN_PROGRESS for 2s [ 773.438258] env[65783]: INFO networking_nsxv3.common.synchronization [req-c939509b-57e7-4e7e-80d7-40ea918b758f req-df5a4d72-4acf-4ac4-a3c1-21e1cb0e5f0a service nova] Enqueued Resource ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c with Priority: HIGHEST for action security_group_rules [ 773.438258] env[65783]: INFO networking_nsxv3.common.synchronization [req-c939509b-57e7-4e7e-80d7-40ea918b758f req-df5a4d72-4acf-4ac4-a3c1-21e1cb0e5f0a service nova] Enqueued Resource ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c with Priority: HIGHEST for action security_group_members [ 773.438258] env[65783]: INFO networking_nsxv3.common.synchronization [req-c939509b-57e7-4e7e-80d7-40ea918b758f req-df5a4d72-4acf-4ac4-a3c1-21e1cb0e5f0a service nova] Enqueued Resource ID: 3a66ab74-5f68-4ab5-939e-de3cc3e69db2 with Priority: HIGHEST for action port [ 773.438258] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c with Priority: HIGHEST for action security_group_rules [ 773.438258] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c with Priority: HIGHEST for action security_group_members [ 773.438258] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a66ab74-5f68-4ab5-939e-de3cc3e69db2 with Priority: HIGHEST for action port [ 773.438813] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5516de4-7ca8-423d-ae28-4654dc2ae29c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.439107] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.439239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.439504] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.439657] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5516de4-7ca8-423d-ae28-4654dc2ae29c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.440994] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5516de4-7ca8-423d-ae28-4654dc2ae29c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.441217] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.441497] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a66ab74-5f68-4ab5-939e-de3cc3e69db2 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.441762] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a66ab74-5f68-4ab5-939e-de3cc3e69db2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.441917] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a66ab74-5f68-4ab5-939e-de3cc3e69db2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.442185] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a66ab74-5f68-4ab5-939e-de3cc3e69db2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.442371] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a66ab74-5f68-4ab5-939e-de3cc3e69db2',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.588932] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3654b92f-abc1-46ca-b6d3-5854c70c886e in Status: SUCCESS [ 773.589296] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3654b92f-abc1-46ca-b6d3-5854c70c886e deletion is rescheduled due to dependency. [ 773.589296] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.945074] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5516de4-7ca8-423d-ae28-4654dc2ae29c taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.945308] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.945688] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a66ab74-5f68-4ab5-939e-de3cc3e69db2 with status ACTIVE [ 773.945688] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.945688] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.946128] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.946128] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.946128] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.946313] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.946417] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.946476] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.946631] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.946709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.946926] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.947071] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.947140] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.947276] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.947387] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.947481] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a66ab74-5f68-4ab5-939e-de3cc3e69db2 is going to be updated. [ 773.968752] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.968841] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.968891] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.969156] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.969301] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.969466] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a66ab74-5f68-4ab5-939e-de3cc3e69db2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.543246] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: SUCCESS [ 774.544030] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd942bf-b305-4707-8084-1ac6b135c741 deletion is rescheduled due to dependency. [ 774.544030] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.309031] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c in Status: SUCCESS [ 775.309031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.309031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.309031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.309031] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.309031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.309031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.309031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.309750] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.309750] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5516de4-7ca8-423d-ae28-4654dc2ae29c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.811577] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5516de4-7ca8-423d-ae28-4654dc2ae29c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.316031] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5516de4-7ca8-423d-ae28-4654dc2ae29c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.818289] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.818452] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.818532] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.818752] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.818844] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.818942] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c is going to be updated. [ 776.852384] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.852614] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.852653] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.852864] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.853031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.865941] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c in Status: IN_PROGRESS for 2s [ 778.438261] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 778.438539] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 778.876941] env[65783]: INFO networking_nsxv3.common.synchronization [req-77ee0ac6-0cf9-44ed-8dc1-f3ab5131e9c6 req-838794cd-eaca-4c23-b4f1-ab38ca717bf9 tempest-AttachInterfacesUnderV243Test-2037762512 tempest-AttachInterfacesUnderV243Test-2037762512-project-member] Enqueued Resource ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 with Priority: HIGHEST for action security_group_members [ 778.877732] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 with Priority: HIGHEST for action security_group_members [ 778.878941] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c in Status: SUCCESS [ 778.879242] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.879636] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.879807] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.879915] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.880473] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.881227] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.881227] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.881227] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.881227] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.881227] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.881227] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9af7ce2b-d35d-49a7-a534-d4ea3a2a2508',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.882272] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.882504] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.882760] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.885133] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.885247] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.885481] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.885597] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.885739] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.885866] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5516de4-7ca8-423d-ae28-4654dc2ae29c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.250828] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-990 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.251166] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-990" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.251789] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-990" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.251789] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-990" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.252070] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.252238] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.252328] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.252753] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.252924] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.253138] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 779.253263] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 779.253367] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 779.253494] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 779.253604] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 779.253783] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 779.253938] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 779.274636] env[65783]: INFO networking_nsxv3.common.synchronization [req-9ff8c5dd-7021-4d48-8005-31fc3fc65d4d req-b78cfd78-6b0d-483e-8c49-d56bb9c0cc5e tempest-ServersTestJSON-1142340636 tempest-ServersTestJSON-1142340636-project-member] Enqueued Resource ID: 14427d59-3459-4ddd-9c42-78877a31172d with Priority: HIGHEST for action security_group_members [ 779.275685] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14427d59-3459-4ddd-9c42-78877a31172d with Priority: HIGHEST for action security_group_members [ 779.276063] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-14427d59-3459-4ddd-9c42-78877a31172d taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.276254] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.276331] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.276662] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.276800] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.276800] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.276887] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.277152] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.277264] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.277368] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14427d59-3459-4ddd-9c42-78877a31172d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.279357] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 779.279541] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 779.279674] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 779.279833] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-990" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.280151] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-a52878da-edb4-4e48-8028-2ef5a48d8253 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.280325] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-a52878da-edb4-4e48-8028-2ef5a48d8253" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.280444] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-a52878da-edb4-4e48-8028-2ef5a48d8253" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.280987] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-a52878da-edb4-4e48-8028-2ef5a48d8253" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.280987] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a52878da-edb4-4e48-8028-2ef5a48d8253',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.388163] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.388261] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.388379] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.388697] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.388826] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.389080] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.389214] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.389579] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.389579] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.389654] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.389688] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 already deleted. [ 779.389792] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.390106] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5516de4-7ca8-423d-ae28-4654dc2ae29c taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.390327] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.390327] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.390804] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.390804] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.390942] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.390974] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.391358] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.391358] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.391485] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.391572] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5516de4-7ca8-423d-ae28-4654dc2ae29c taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.391733] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.391843] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.392197] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.392410] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.392529] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.392593] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.392735] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.392810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.392889] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.392981] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5516de4-7ca8-423d-ae28-4654dc2ae29c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.783753] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.784028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.784028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.784238] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.784332] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.784522] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.784619] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.784681] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.784829] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.784904] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.784988] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14427d59-3459-4ddd-9c42-78877a31172d is going to be updated. [ 779.787263] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.787432] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.787574] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.787771] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.787916] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.788062] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port a52878da-edb4-4e48-8028-2ef5a48d8253 not found, creating... [ 779.788327] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.788480] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.788671] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.788804] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.788939] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.789233] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.789383] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.789491] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.789690] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.789813] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.789942] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: a52878da-edb4-4e48-8028-2ef5a48d8253 is going to be created. [ 779.815105] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.815105] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.815289] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.817203] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.817203] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.817203] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-a52878da-edb4-4e48-8028-2ef5a48d8253" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.824588] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.824588] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.824588] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.824588] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.824588] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.835112] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14427d59-3459-4ddd-9c42-78877a31172d in Status: IN_PROGRESS for 2s [ 779.897062] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5516de4-7ca8-423d-ae28-4654dc2ae29c: rpc.has_security_group_logging(os_id): False [ 779.917839] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.918045] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.918090] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.918346] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.918387] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.918581] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.918682] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.918784] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.918949] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.918982] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.919567] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.919567] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.919567] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.919567] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.919739] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.919785] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.920031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.920031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.920220] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.920316] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.920430] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c is going to be updated. [ 779.993026] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.993277] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.993374] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.993537] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.993692] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.011506] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c in Status: IN_PROGRESS for 2s [ 780.506382] env[65783]: INFO networking_nsxv3.common.synchronization [req-77ee0ac6-0cf9-44ed-8dc1-f3ab5131e9c6 req-0790a72a-6e0c-43cb-bd9c-514486213f59 service nova] Enqueued Resource ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 with Priority: HIGHEST for action security_group_rules [ 780.506382] env[65783]: INFO networking_nsxv3.common.synchronization [req-77ee0ac6-0cf9-44ed-8dc1-f3ab5131e9c6 req-0790a72a-6e0c-43cb-bd9c-514486213f59 service nova] Enqueued Resource ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 with Priority: HIGHEST for action security_group_members [ 780.506670] env[65783]: INFO networking_nsxv3.common.synchronization [req-77ee0ac6-0cf9-44ed-8dc1-f3ab5131e9c6 req-0790a72a-6e0c-43cb-bd9c-514486213f59 service nova] Enqueued Resource ID: a52878da-edb4-4e48-8028-2ef5a48d8253 with Priority: HIGHEST for action port [ 780.507019] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 with Priority: HIGHEST for action security_group_rules [ 780.507169] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 with Priority: HIGHEST for action security_group_members [ 780.507266] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a52878da-edb4-4e48-8028-2ef5a48d8253 with Priority: HIGHEST for action port [ 780.507538] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.507659] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.507724] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.507917] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.507999] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9af7ce2b-d35d-49a7-a534-d4ea3a2a2508',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.508855] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.508977] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.509057] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.509197] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.509344] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.509429] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.509486] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.509633] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.509701] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.509791] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9af7ce2b-d35d-49a7-a534-d4ea3a2a2508',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.510938] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-a52878da-edb4-4e48-8028-2ef5a48d8253 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.510938] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a52878da-edb4-4e48-8028-2ef5a48d8253" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.510938] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a52878da-edb4-4e48-8028-2ef5a48d8253" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.510938] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a52878da-edb4-4e48-8028-2ef5a48d8253" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.510938] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a52878da-edb4-4e48-8028-2ef5a48d8253',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.012640] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9af7ce2b-d35d-49a7-a534-d4ea3a2a2508',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.019639] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.019639] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.019639] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a52878da-edb4-4e48-8028-2ef5a48d8253 with status ACTIVE [ 781.019639] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.019639] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.019639] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.019639] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.019639] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.019639] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.019639] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.019639] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.019639] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.019639] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.019639] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.020372] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.020372] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.020372] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.020372] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.020372] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a52878da-edb4-4e48-8028-2ef5a48d8253 is going to be updated. [ 781.045706] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.045865] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.046380] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.046380] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.046380] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.046937] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a52878da-edb4-4e48-8028-2ef5a48d8253" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.518222] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9af7ce2b-d35d-49a7-a534-d4ea3a2a2508',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.845209] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14427d59-3459-4ddd-9c42-78877a31172d in Status: SUCCESS [ 781.845503] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14427d59-3459-4ddd-9c42-78877a31172d deletion is rescheduled due to dependency. [ 781.845870] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.020418] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.020709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.020709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.020908] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.021173] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.021456] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 is going to be created. [ 782.028804] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c in Status: SUCCESS [ 782.029207] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.052639] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.052834] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.052912] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.053143] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.053298] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.066725] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 in Status: UNINITIALIZED for 2s [ 784.080945] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 in Status: SUCCESS [ 784.081927] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.081927] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.082062] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.082259] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.082413] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.082484] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.082644] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.082727] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.083604] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.083604] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9af7ce2b-d35d-49a7-a534-d4ea3a2a2508',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.386480] env[65783]: INFO networking_nsxv3.common.synchronization [req-0fd73021-ac17-4c4d-bbf3-66b5333de0ce req-6b43cde9-1621-424e-b0b5-c4254549ce82 tempest-ListImageFiltersTestJSON-600591362 tempest-ListImageFiltersTestJSON-600591362-project-member] Enqueued Resource ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 with Priority: HIGHEST for action security_group_members [ 784.387352] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 with Priority: HIGHEST for action security_group_members [ 784.387563] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-177e22b5-9104-44ad-8e54-e2d4da7915c9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.387696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.387744] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.388017] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.388243] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.388409] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.393027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.393027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.393027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.393027] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('177e22b5-9104-44ad-8e54-e2d4da7915c9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.585721] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9af7ce2b-d35d-49a7-a534-d4ea3a2a2508',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.708777] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-251 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.708966] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.709595] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.709595] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.709722] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.709854] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.709968] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.710198] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.710637] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.710860] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 784.710973] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 784.711090] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 784.711195] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 784.711368] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 784.711477] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 784.711604] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 784.730969] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 784.731156] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 784.731376] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 784.731585] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.731914] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-05d3722d-6c89-4066-84f7-83e285df6855 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.732134] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-05d3722d-6c89-4066-84f7-83e285df6855" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.732200] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-05d3722d-6c89-4066-84f7-83e285df6855" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.732579] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-05d3722d-6c89-4066-84f7-83e285df6855" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.732716] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05d3722d-6c89-4066-84f7-83e285df6855',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.895481] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.895721] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.895831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.896049] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.896155] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.896373] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.896807] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.896807] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.896807] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.896920] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.897042] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 already deleted. [ 784.897172] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.088269] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508: rpc.has_security_group_logging(os_id): False [ 785.108341] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.108553] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.108553] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.108782] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.109030] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.109312] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.109424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.109499] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.109684] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.109749] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.109878] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 is going to be created. [ 785.178299] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.178510] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.178618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.178786] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.178962] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.193101] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 in Status: IN_PROGRESS for 2s [ 785.236505] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.236791] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.236944] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.237282] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.237463] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.237724] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 05d3722d-6c89-4066-84f7-83e285df6855 not found, creating... [ 785.237942] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.238126] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.238242] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.238492] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.239266] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.239266] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.239266] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.239266] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.239549] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.239549] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.239621] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 05d3722d-6c89-4066-84f7-83e285df6855 is going to be created. [ 785.284754] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.284975] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.285106] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.285388] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.285608] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.285830] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-05d3722d-6c89-4066-84f7-83e285df6855" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.063309] env[65783]: INFO networking_nsxv3.common.synchronization [req-0fd73021-ac17-4c4d-bbf3-66b5333de0ce req-23e73f32-9f34-439d-9b38-649603ab1290 service nova] Enqueued Resource ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 with Priority: HIGHEST for action security_group_rules [ 786.064029] env[65783]: INFO networking_nsxv3.common.synchronization [req-0fd73021-ac17-4c4d-bbf3-66b5333de0ce req-23e73f32-9f34-439d-9b38-649603ab1290 service nova] Enqueued Resource ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 with Priority: HIGHEST for action security_group_members [ 786.064029] env[65783]: INFO networking_nsxv3.common.synchronization [req-0fd73021-ac17-4c4d-bbf3-66b5333de0ce req-23e73f32-9f34-439d-9b38-649603ab1290 service nova] Enqueued Resource ID: 05d3722d-6c89-4066-84f7-83e285df6855 with Priority: HIGHEST for action port [ 786.064785] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 with Priority: HIGHEST for action security_group_rules [ 786.064957] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 with Priority: HIGHEST for action security_group_members [ 786.065100] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05d3722d-6c89-4066-84f7-83e285df6855 with Priority: HIGHEST for action port [ 786.065444] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-177e22b5-9104-44ad-8e54-e2d4da7915c9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.065609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.065707] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.065999] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.066315] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('177e22b5-9104-44ad-8e54-e2d4da7915c9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.068077] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-177e22b5-9104-44ad-8e54-e2d4da7915c9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.068211] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.068278] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.068475] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.068632] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.068729] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.068938] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.069607] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.069745] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.069934] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('177e22b5-9104-44ad-8e54-e2d4da7915c9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.071069] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-05d3722d-6c89-4066-84f7-83e285df6855 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.071187] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05d3722d-6c89-4066-84f7-83e285df6855" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.071277] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05d3722d-6c89-4066-84f7-83e285df6855" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.071583] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05d3722d-6c89-4066-84f7-83e285df6855" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.071670] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05d3722d-6c89-4066-84f7-83e285df6855',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.568511] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-177e22b5-9104-44ad-8e54-e2d4da7915c9 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.568847] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.574125] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('177e22b5-9104-44ad-8e54-e2d4da7915c9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.577061] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05d3722d-6c89-4066-84f7-83e285df6855 with status ACTIVE [ 786.577061] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.577222] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.577266] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.577717] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.577717] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.577819] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.577887] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.577921] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.578308] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.578450] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.578664] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.578762] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.578822] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.578981] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.579066] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.579178] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05d3722d-6c89-4066-84f7-83e285df6855 is going to be updated. [ 786.603312] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.603491] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.603564] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.603792] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.603924] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.604090] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05d3722d-6c89-4066-84f7-83e285df6855" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.076962] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('177e22b5-9104-44ad-8e54-e2d4da7915c9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.133359] env[65783]: INFO networking_nsxv3.common.synchronization [req-23b76d21-fb6b-4b3b-856a-3d796dd57ec5 req-272e6b4f-e017-408a-b495-1fa7eeea13f5 tempest-ServersAdminTestJSON-345343376 tempest-ServersAdminTestJSON-345343376-project-member] Enqueued Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_members [ 787.135271] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_members [ 787.135271] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca99b1a6-3702-4011-942b-06036fda2165 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.135271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.135271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.136371] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.136371] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.136371] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.136371] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.136371] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.136753] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.136753] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.206078] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 in Status: SUCCESS [ 787.206174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.579888] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.579888] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.579888] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.580298] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.580298] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.580298] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 is going to be created. [ 787.609756] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.609862] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.609917] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.610166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.610334] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.621894] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 in Status: UNINITIALIZED for 2s [ 787.640104] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.142256] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.279034] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.279220] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.279302] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.279554] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.279662] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.646028] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.646028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.646028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.646321] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.646321] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.646431] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca99b1a6-3702-4011-942b-06036fda2165 is going to be updated. [ 788.677659] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.677659] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.677849] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.678049] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.678395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.692189] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: IN_PROGRESS for 2s [ 788.783890] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.286451] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.340707] env[65783]: INFO networking_nsxv3.common.synchronization [req-54969e91-4142-4484-b4bf-42d615cbd979 req-a9c2530c-5b80-47a3-b077-da268fb458c5 tempest-ListImageFiltersTestJSON-600591362 tempest-ListImageFiltersTestJSON-600591362-project-member] Enqueued Resource ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 with Priority: HIGHEST for action security_group_members [ 789.341250] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 with Priority: HIGHEST for action security_group_members [ 789.341978] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-177e22b5-9104-44ad-8e54-e2d4da7915c9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.342104] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.588756] env[65783]: INFO networking_nsxv3.common.synchronization [req-1e6b12ed-7053-4b40-82bd-abe4f1d7b0cd req-6a0fe625-4133-48bb-b955-739c863bd786 tempest-FloatingIPsAssociationTestJSON-1491106384 tempest-FloatingIPsAssociationTestJSON-1491106384-project-member] Enqueued Resource ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e with Priority: HIGHEST for action security_group_members [ 789.589443] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e with Priority: HIGHEST for action security_group_members [ 789.589794] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.589946] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.590185] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.590438] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.590663] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.590831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.590923] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.591053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.591179] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.591318] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d536ed15-4c4c-44ea-b9bd-1b0e46123d7e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.633800] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 in Status: SUCCESS [ 789.634069] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.634279] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.634531] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.634723] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.634874] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.634933] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.635143] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.635229] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.635318] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.635477] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('177e22b5-9104-44ad-8e54-e2d4da7915c9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.636355] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.636527] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.636686] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.636799] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.636865] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.637019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.637110] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.637206] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('177e22b5-9104-44ad-8e54-e2d4da7915c9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.705450] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-251 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.705805] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.705906] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.706090] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.706505] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.706679] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.706792] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.707012] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.707160] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.707536] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 789.707652] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 789.707753] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 789.707853] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 789.707956] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 789.708065] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 789.708217] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 789.731955] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 789.732162] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 789.732250] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 789.732452] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-251" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.732770] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-4a920eec-6022-4912-93e4-46affc7b4d18 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.732938] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-4a920eec-6022-4912-93e4-46affc7b4d18" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.733061] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-4a920eec-6022-4912-93e4-46affc7b4d18" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.733395] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-4a920eec-6022-4912-93e4-46affc7b4d18" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.733551] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a920eec-6022-4912-93e4-46affc7b4d18',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.789652] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 789.789831] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 789.987208] env[65783]: INFO networking_nsxv3.common.synchronization [req-245817d2-8cf2-4f03-b598-7419b5b4fbf6 req-a1717314-f7fe-453b-8b8d-1b3981d98036 tempest-ServersAdminNegativeTestJSON-2089691366 tempest-ServersAdminNegativeTestJSON-2089691366-project-member] Enqueued Resource ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c with Priority: HIGHEST for action security_group_members [ 789.987478] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c with Priority: HIGHEST for action security_group_members [ 789.987837] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5516de4-7ca8-423d-ae28-4654dc2ae29c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.987971] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.988129] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.988347] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.988505] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.988607] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.988691] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.988888] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.989039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.989199] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5516de4-7ca8-423d-ae28-4654dc2ae29c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.093450] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.093751] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.093862] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.094104] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.094347] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.094679] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.094790] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.094855] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.095032] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.095115] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.095202] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e is going to be updated. [ 790.140802] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('177e22b5-9104-44ad-8e54-e2d4da7915c9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.143172] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-177e22b5-9104-44ad-8e54-e2d4da7915c9 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.143172] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.155156] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.155841] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.155841] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.155841] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.155841] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.175322] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e in Status: IN_PROGRESS for 2s [ 790.236790] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.236790] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.236790] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.237029] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.237134] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.237288] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 4a920eec-6022-4912-93e4-46affc7b4d18 not found, creating... [ 790.237606] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.237778] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.237891] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.238131] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.238261] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.239027] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.239027] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.239027] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.239027] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.239758] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.239910] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 4a920eec-6022-4912-93e4-46affc7b4d18 is going to be created. [ 790.263497] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.263702] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.265348] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.265348] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.265348] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.265348] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-4a920eec-6022-4912-93e4-46affc7b4d18" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.491624] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5516de4-7ca8-423d-ae28-4654dc2ae29c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.645248] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('177e22b5-9104-44ad-8e54-e2d4da7915c9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.705555] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: SUCCESS [ 790.705555] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.734028] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.734028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.734028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.734028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.748515] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 790.749786] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.751480] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 790.785461] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.785783] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.785909] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.786186] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.792411] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.793127] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 790.793257] env[65783]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65783) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 790.793410] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 790.830366] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.830512] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.830584] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.830957] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.832627] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.832627] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 790.902676] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.902920] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.903039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.903178] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.903442] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.903750] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 790.991488] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.991753] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.991753] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.991956] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.992319] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.992560] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:31. [ 790.992655] env[65783]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'dd42c762-b73d-4959-95b1-e671bccc381e', '752cf951-e22b-4bfc-b89a-6766804d295f', 'efd942bf-b305-4707-8084-1ac6b135c741', 'c5516de4-7ca8-423d-ae28-4654dc2ae29c', 'd536ed15-4c4c-44ea-b9bd-1b0e46123d7e', '0c4389af-195b-4eda-a15f-a441817ee12a', 'd62819d6-c7c5-47a8-a028-a438cb9528b5', '29c3066f-92d6-4fd9-a20b-96651c82bc4b', 'e285eaec-686f-4ae5-a9aa-59215e24189f', '3654b92f-abc1-46ca-b6d3-5854c70c886e', '8fb4d28c-13d7-48fd-b533-e7a002a7949d', 'b4233009-fbd8-4936-abda-bc37e3d37b55', '8c81f8cb-609b-4496-9f07-b80abbe519f8', 'e588ff7c-d45a-4b75-823e-f219eeb5e814', '9943d881-28bf-4885-906c-d360f9c2c3e7', '14427d59-3459-4ddd-9c42-78877a31172d', '0010338f-67e3-417c-be88-4e0a85ad75aa', '12b54335-eb35-490d-a8d9-d12ac5809eb9', 'faef4af0-512c-4f90-a00c-065908fadd11', '85cfbc91-333d-4a17-874c-c9f26dffaadd', 'b6e66254-5e43-437b-850b-825eaaa0cee1', 'ca99b1a6-3702-4011-942b-06036fda2165', '40fa215c-6810-4862-9ddc-1bca888b2ee5', 'c6dc57fb-f44d-4b26-87fe-bb8e4df202a8', 'b56f5230-554e-48f1-aef4-fcf2593b50d3', '7998a549-f70e-4b58-992e-5c5ab6652711', 'aaf15510-666a-49d9-9a20-6f398b7f8216', '527a6015-4311-4050-9945-7b4c6e602f59', 'c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47', '9af7ce2b-d35d-49a7-a534-d4ea3a2a2508', '5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40'} {{(pid=65783) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 790.992757] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 790.993946] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5516de4-7ca8-423d-ae28-4654dc2ae29c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.016496] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.016496] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.016992] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.016992] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.016992] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.016992] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 791.016992] env[65783]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65783) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 791.017208] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 791.064399] env[65783]: INFO networking_nsxv3.common.synchronization [req-54969e91-4142-4484-b4bf-42d615cbd979 req-208b748a-0033-48b3-accc-97d7a7da45fd service nova] Enqueued Resource ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 with Priority: HIGHEST for action security_group_rules [ 791.064614] env[65783]: INFO networking_nsxv3.common.synchronization [req-54969e91-4142-4484-b4bf-42d615cbd979 req-208b748a-0033-48b3-accc-97d7a7da45fd service nova] Enqueued Resource ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 with Priority: HIGHEST for action security_group_members [ 791.068687] env[65783]: INFO networking_nsxv3.common.synchronization [req-54969e91-4142-4484-b4bf-42d615cbd979 req-208b748a-0033-48b3-accc-97d7a7da45fd service nova] Enqueued Resource ID: 4a920eec-6022-4912-93e4-46affc7b4d18 with Priority: HIGHEST for action port [ 791.068687] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 with Priority: HIGHEST for action security_group_rules [ 791.068687] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 with Priority: HIGHEST for action security_group_members [ 791.068687] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a920eec-6022-4912-93e4-46affc7b4d18 with Priority: HIGHEST for action port [ 791.068687] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-177e22b5-9104-44ad-8e54-e2d4da7915c9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.068687] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.068687] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-177e22b5-9104-44ad-8e54-e2d4da7915c9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.068687] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.068687] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a920eec-6022-4912-93e4-46affc7b4d18 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.068687] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a920eec-6022-4912-93e4-46affc7b4d18" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.068687] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a920eec-6022-4912-93e4-46affc7b4d18" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.069212] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a920eec-6022-4912-93e4-46affc7b4d18" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.069212] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a920eec-6022-4912-93e4-46affc7b4d18',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.084394] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.084648] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.084648] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.084834] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.085594] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.085812] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 791.085912] env[65783]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65783) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 791.087339] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 791.087339] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 791.087339] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/31 resources of Type:Security Group Rules [ 791.087339] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dd42c762-b73d-4959-95b1-e671bccc381e with Priority: HIGH for action security_group_rules [ 791.087339] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 752cf951-e22b-4bfc-b89a-6766804d295f with Priority: HIGH for action security_group_rules [ 791.087339] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGH for action security_group_rules [ 791.087339] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c with Priority: HIGH for action security_group_rules [ 791.087339] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e with Priority: HIGH for action security_group_rules [ 791.087339] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0c4389af-195b-4eda-a15f-a441817ee12a with Priority: HIGH for action security_group_rules [ 791.087339] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 with Priority: HIGH for action security_group_rules [ 791.087339] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 29c3066f-92d6-4fd9-a20b-96651c82bc4b with Priority: HIGH for action security_group_rules [ 791.087339] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e285eaec-686f-4ae5-a9aa-59215e24189f with Priority: HIGH for action security_group_rules [ 791.087339] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3654b92f-abc1-46ca-b6d3-5854c70c886e with Priority: HIGH for action security_group_rules [ 791.087339] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8fb4d28c-13d7-48fd-b533-e7a002a7949d with Priority: HIGH for action security_group_rules [ 791.087339] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b4233009-fbd8-4936-abda-bc37e3d37b55 with Priority: HIGH for action security_group_rules [ 791.087339] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGH for action security_group_rules [ 791.087820] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 with Priority: HIGH for action security_group_rules [ 791.087820] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGH for action security_group_rules [ 791.087820] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 14427d59-3459-4ddd-9c42-78877a31172d with Priority: HIGH for action security_group_rules [ 791.087820] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0010338f-67e3-417c-be88-4e0a85ad75aa with Priority: HIGH for action security_group_rules [ 791.087820] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 12b54335-eb35-490d-a8d9-d12ac5809eb9 with Priority: HIGH for action security_group_rules [ 791.087820] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: faef4af0-512c-4f90-a00c-065908fadd11 with Priority: HIGH for action security_group_rules [ 791.087820] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 85cfbc91-333d-4a17-874c-c9f26dffaadd with Priority: HIGH for action security_group_rules [ 791.087820] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.146634] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.146881] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.147161] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.147408] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.147522] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.147612] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 is going to be updated. [ 791.186488] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.186763] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.186763] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.186900] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.187069] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.200299] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 in Status: IN_PROGRESS for 2s [ 791.496234] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.496405] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.496477] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.497158] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.497158] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.497158] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c is going to be updated. [ 791.527701] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.527701] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.527701] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.527701] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.527954] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.538762] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c in Status: IN_PROGRESS for 2s [ 791.573143] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a920eec-6022-4912-93e4-46affc7b4d18 with status ACTIVE [ 791.573375] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.573509] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.573576] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.574209] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.574316] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.574505] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.574608] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.574670] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.574828] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.574906] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.575101] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.575208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.575585] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.575769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.575866] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.575973] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a920eec-6022-4912-93e4-46affc7b4d18 is going to be updated. [ 791.597583] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.597859] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.597859] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.598018] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.598152] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.598460] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a920eec-6022-4912-93e4-46affc7b4d18" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.186886] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e in Status: SUCCESS [ 792.186886] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e deletion is rescheduled due to dependency. [ 792.186886] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.212590] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 in Status: SUCCESS [ 793.212958] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.213149] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.213433] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.213825] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.214029] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.215372] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.215372] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.215372] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.215372] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.215372] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-177e22b5-9104-44ad-8e54-e2d4da7915c9 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.215372] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.215372] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.215372] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.215372] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.215819] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.215819] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.215819] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.215819] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.215819] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.215981] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('177e22b5-9104-44ad-8e54-e2d4da7915c9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.216975] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.217164] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.217323] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.217430] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.217491] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.217629] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.217721] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.217916] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('177e22b5-9104-44ad-8e54-e2d4da7915c9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.550869] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c in Status: SUCCESS [ 793.550869] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.720427] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 177e22b5-9104-44ad-8e54-e2d4da7915c9: rpc.has_security_group_logging(os_id): False [ 793.721544] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('177e22b5-9104-44ad-8e54-e2d4da7915c9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.744887] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.745112] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.745112] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.745501] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.745501] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.745825] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.745982] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.746104] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.746343] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.746484] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.746735] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.746889] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.746983] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.747587] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.747681] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.748083] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.748256] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.748374] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.748602] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.748705] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.748874] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 is going to be created. [ 793.840123] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.840277] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.840343] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.840554] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.840728] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.852867] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 in Status: IN_PROGRESS for 2s [ 794.225677] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('177e22b5-9104-44ad-8e54-e2d4da7915c9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.730364] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.730524] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.730611] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.730844] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.730931] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.731048] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 is going to be updated. [ 794.765158] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.765301] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.765440] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.765581] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.765728] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.775449] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 in Status: IN_PROGRESS for 2s [ 795.645195] env[65783]: INFO networking_nsxv3.common.synchronization [None req-882ec26f-0e88-459f-b63c-bd8f43003540 None None] Enqueued Resource ID: 03d64e0c-8ce8-4b87-a9d0-55c5a1d9ac83 with Priority: HIGHEST for action port [ 795.645510] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03d64e0c-8ce8-4b87-a9d0-55c5a1d9ac83 with Priority: HIGHEST for action port [ 795.645547] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd42c762-b73d-4959-95b1-e671bccc381e with Priority: HIGH for action security_group_rules [ 795.645622] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGH for action security_group_rules [ 795.645714] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 with Priority: HIGH for action security_group_rules [ 795.645805] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGH for action security_group_rules [ 795.645893] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cfbc91-333d-4a17-874c-c9f26dffaadd with Priority: HIGH for action security_group_rules [ 795.645980] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faef4af0-512c-4f90-a00c-065908fadd11 with Priority: HIGH for action security_group_rules [ 795.646189] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12b54335-eb35-490d-a8d9-d12ac5809eb9 with Priority: HIGH for action security_group_rules [ 795.646438] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0010338f-67e3-417c-be88-4e0a85ad75aa with Priority: HIGH for action security_group_rules [ 795.646438] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 with Priority: HIGH for action security_group_rules [ 795.646525] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14427d59-3459-4ddd-9c42-78877a31172d with Priority: HIGH for action security_group_rules [ 795.647778] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGH for action security_group_rules [ 795.647778] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4233009-fbd8-4936-abda-bc37e3d37b55 with Priority: HIGH for action security_group_rules [ 795.647778] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fb4d28c-13d7-48fd-b533-e7a002a7949d with Priority: HIGH for action security_group_rules [ 795.647778] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3654b92f-abc1-46ca-b6d3-5854c70c886e with Priority: HIGH for action security_group_rules [ 795.647778] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e285eaec-686f-4ae5-a9aa-59215e24189f with Priority: HIGH for action security_group_rules [ 795.647778] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4389af-195b-4eda-a15f-a441817ee12a with Priority: HIGH for action security_group_rules [ 795.647778] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29c3066f-92d6-4fd9-a20b-96651c82bc4b with Priority: HIGH for action security_group_rules [ 795.647778] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e with Priority: HIGH for action security_group_rules [ 795.648154] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 752cf951-e22b-4bfc-b89a-6766804d295f with Priority: HIGH for action security_group_rules [ 795.648154] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c with Priority: HIGH for action security_group_rules [ 795.648306] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-03d64e0c-8ce8-4b87-a9d0-55c5a1d9ac83 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.648306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03d64e0c-8ce8-4b87-a9d0-55c5a1d9ac83" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.648462] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03d64e0c-8ce8-4b87-a9d0-55c5a1d9ac83" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.648670] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03d64e0c-8ce8-4b87-a9d0-55c5a1d9ac83" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.648751] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03d64e0c-8ce8-4b87-a9d0-55c5a1d9ac83',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.649638] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd42c762-b73d-4959-95b1-e671bccc381e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.649750] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.649806] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.650264] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.650417] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd42c762-b73d-4959-95b1-e671bccc381e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.651696] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.651696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.651696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.651856] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.651856] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.653341] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d62819d6-c7c5-47a8-a028-a438cb9528b5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.653341] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.653511] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.653548] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.653916] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d62819d6-c7c5-47a8-a028-a438cb9528b5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.654861] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.655062] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.655126] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.655287] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.655356] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.657145] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85cfbc91-333d-4a17-874c-c9f26dffaadd taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.657145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.657145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.657359] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.657359] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85cfbc91-333d-4a17-874c-c9f26dffaadd',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.658244] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-faef4af0-512c-4f90-a00c-065908fadd11 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.658349] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.658393] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.658547] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.658977] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('faef4af0-512c-4f90-a00c-065908fadd11',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.659649] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12b54335-eb35-490d-a8d9-d12ac5809eb9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.659748] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.660487] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.660487] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.660487] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12b54335-eb35-490d-a8d9-d12ac5809eb9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.661878] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0010338f-67e3-417c-be88-4e0a85ad75aa taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.661878] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.661878] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.661878] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.661878] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0010338f-67e3-417c-be88-4e0a85ad75aa',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.662285] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e588ff7c-d45a-4b75-823e-f219eeb5e814 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.662285] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.662285] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.662480] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.662533] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e588ff7c-d45a-4b75-823e-f219eeb5e814',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.663341] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14427d59-3459-4ddd-9c42-78877a31172d taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.663456] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.663532] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.663672] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.664020] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14427d59-3459-4ddd-9c42-78877a31172d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.664202] env[65783]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 795.664899] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c81f8cb-609b-4496-9f07-b80abbe519f8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.665012] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.665076] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.665226] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.665297] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.666119] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4233009-fbd8-4936-abda-bc37e3d37b55 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.666234] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.666285] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.666428] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.666499] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4233009-fbd8-4936-abda-bc37e3d37b55',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.667530] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8fb4d28c-13d7-48fd-b533-e7a002a7949d taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.667530] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.667530] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.667713] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.667713] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8fb4d28c-13d7-48fd-b533-e7a002a7949d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.668689] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3654b92f-abc1-46ca-b6d3-5854c70c886e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.668802] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.668850] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.668995] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.669081] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3654b92f-abc1-46ca-b6d3-5854c70c886e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.669957] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e285eaec-686f-4ae5-a9aa-59215e24189f taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.670145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.670145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.670270] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.670334] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e285eaec-686f-4ae5-a9aa-59215e24189f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.671581] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c4389af-195b-4eda-a15f-a441817ee12a taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.671775] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.671775] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.671955] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.671955] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c4389af-195b-4eda-a15f-a441817ee12a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.672771] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29c3066f-92d6-4fd9-a20b-96651c82bc4b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.672869] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.672947] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.673087] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.673155] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29c3066f-92d6-4fd9-a20b-96651c82bc4b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.674031] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.674474] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.674474] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.674474] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.674616] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d536ed15-4c4c-44ea-b9bd-1b0e46123d7e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.676696] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-752cf951-e22b-4bfc-b89a-6766804d295f taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.676696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.676696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.676696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.676696] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('752cf951-e22b-4bfc-b89a-6766804d295f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.676964] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5516de4-7ca8-423d-ae28-4654dc2ae29c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.677047] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.677116] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.677250] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.677317] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5516de4-7ca8-423d-ae28-4654dc2ae29c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.678101] env[65783]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 795.706865] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.707158] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.707158] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.707306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.734113] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.734386] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd42c762-b73d-4959-95b1-e671bccc381e is going to be deleted. [ 795.797260] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.797260] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.797260] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.797260] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.797260] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.797260] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd42c762-b73d-4959-95b1-e671bccc381e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.873846] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 in Status: SUCCESS [ 795.874437] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.874437] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.874575] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.874609] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('177e22b5-9104-44ad-8e54-e2d4da7915c9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.180863] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 03d64e0c-8ce8-4b87-a9d0-55c5a1d9ac83 [ 796.181385] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.183443] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.183443] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.183443] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.183443] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.183443] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:03d64e0c-8ce8-4b87-a9d0-55c5a1d9ac83 already deleted. [ 796.183443] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03d64e0c-8ce8-4b87-a9d0-55c5a1d9ac83" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.202066] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.202272] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.202272] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.202568] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.216780] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-d62819d6-c7c5-47a8-a028-a438cb9528b5 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.216958] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.218200] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.218200] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.218200] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.218200] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.218200] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.218200] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.218552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.218552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.218552] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d62819d6-c7c5-47a8-a028-a438cb9528b5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.225963] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c81f8cb-609b-4496-9f07-b80abbe519f8 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.226352] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.226439] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.226648] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.226834] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.226937] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.227018] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.227177] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.228145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.228145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.228145] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.231499] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-752cf951-e22b-4bfc-b89a-6766804d295f taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.231499] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.231499] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.231872] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.231872] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.231872] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.231981] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.232118] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.232209] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.232295] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.232376] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('752cf951-e22b-4bfc-b89a-6766804d295f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.235919] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5516de4-7ca8-423d-ae28-4654dc2ae29c taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.236052] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.236116] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.236302] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.236458] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.236551] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.236599] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.236750] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.236848] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.236980] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.237086] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5516de4-7ca8-423d-ae28-4654dc2ae29c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.241226] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-0010338f-67e3-417c-be88-4e0a85ad75aa taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.241447] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.241524] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.241800] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.241984] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.242155] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.242254] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.242493] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.242605] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.242737] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.242855] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0010338f-67e3-417c-be88-4e0a85ad75aa',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.246552] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.246552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.246552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.246552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.246552] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.246552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.246552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.246552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.246912] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.246912] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.246912] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.255222] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.255395] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efd942bf-b305-4707-8084-1ac6b135c741 is going to be deleted. [ 796.262348] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5516de4-7ca8-423d-ae28-4654dc2ae29c taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.262348] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.262348] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.262348] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.262578] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.262704] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.262786] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.262973] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.263117] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.263296] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.263429] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5516de4-7ca8-423d-ae28-4654dc2ae29c taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.263550] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.263587] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.264723] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.264723] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.264723] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.264723] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.264723] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.264723] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.264723] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.264723] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5516de4-7ca8-423d-ae28-4654dc2ae29c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.265618] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d62819d6-c7c5-47a8-a028-a438cb9528b5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.270239] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('752cf951-e22b-4bfc-b89a-6766804d295f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.337203] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.337392] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.337432] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.337669] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.339981] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.339981] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.340712] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.341510] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.342147] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.342242] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.343226] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.343340] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.344135] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.344229] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.348036] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.348036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.348036] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.348036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.348036] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.348036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.348036] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.348036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.348448] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.348448] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.349606] env[65783]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 796.350880] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.350880] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.377256] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-177e22b5-9104-44ad-8e54-e2d4da7915c9 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.377416] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.383160] env[65783]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 796.383849] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.383937] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: faef4af0-512c-4f90-a00c-065908fadd11 is going to be deleted. [ 796.385200] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.385445] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.410228] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.410447] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d536ed15-4c4c-44ea-b9bd-1b0e46123d7e is going to be deleted. [ 796.411999] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.411999] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.413576] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.413719] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.437240] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.437395] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8fb4d28c-13d7-48fd-b533-e7a002a7949d is going to be deleted. [ 796.438606] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.438738] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.472035] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.472195] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.479666] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.479897] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12b54335-eb35-490d-a8d9-d12ac5809eb9 is going to be deleted. [ 796.481260] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.481852] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.504569] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.504705] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.512478] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.512662] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e285eaec-686f-4ae5-a9aa-59215e24189f is going to be deleted. [ 796.513801] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.514065] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.531905] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.532372] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.556732] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.557169] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c4389af-195b-4eda-a15f-a441817ee12a is going to be deleted. [ 796.558889] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.558889] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.590249] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.591187] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.608820] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.608820] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.629554] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.629713] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3654b92f-abc1-46ca-b6d3-5854c70c886e is going to be deleted. [ 796.631073] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.631314] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.711387] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.711387] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85cfbc91-333d-4a17-874c-c9f26dffaadd is going to be deleted. [ 796.712769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.713135] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.754049] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.758499] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.758581] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.758654] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.758902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.759113] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.759269] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.759338] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.759541] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.759663] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.759913] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.760110] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.761115] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.761220] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.761449] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.761649] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.761794] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.761880] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.762101] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.762313] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.762470] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.763775] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.764871] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-0010338f-67e3-417c-be88-4e0a85ad75aa taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.764985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.765061] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.765234] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.765389] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.765486] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.765545] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.765855] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.765944] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.766039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.766187] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-0010338f-67e3-417c-be88-4e0a85ad75aa taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.766305] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.766381] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.766542] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.766699] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.766807] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.766993] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.767249] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.767334] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.767438] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.768560] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0010338f-67e3-417c-be88-4e0a85ad75aa',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.774657] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5516de4-7ca8-423d-ae28-4654dc2ae29c: rpc.has_security_group_logging(os_id): False [ 796.781482] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d62819d6-c7c5-47a8-a028-a438cb9528b5: rpc.has_security_group_logging(os_id): False [ 796.783279] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 752cf951-e22b-4bfc-b89a-6766804d295f: rpc.has_security_group_logging(os_id): False [ 796.784826] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.784940] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.794829] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.794829] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 is going to be deleted. [ 796.795191] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.795416] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.804447] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 in Status: SUCCESS [ 796.804801] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.804854] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.805078] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.805802] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.805802] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.805802] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.805802] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.805802] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.805802] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.806077] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('177e22b5-9104-44ad-8e54-e2d4da7915c9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.821720] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.821926] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.841687] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.841982] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14427d59-3459-4ddd-9c42-78877a31172d is going to be deleted. [ 796.843263] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.843553] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.860590] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.860590] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.861278] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.861454] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.874937] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.875298] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.877864] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.878766] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.926651] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.927538] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29c3066f-92d6-4fd9-a20b-96651c82bc4b is going to be deleted. [ 796.928508] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.928747] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.986157] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.986660] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.993769] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.993966] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.998805] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.998952] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4233009-fbd8-4936-abda-bc37e3d37b55 is going to be deleted. [ 796.999875] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.000098] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.000187] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.000306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.000481] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.000635] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.000712] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.000884] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-faef4af0-512c-4f90-a00c-065908fadd11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.003454] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.004541] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.004667] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.005173] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d536ed15-4c4c-44ea-b9bd-1b0e46123d7e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.005173] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.005173] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.005367] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.005367] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8fb4d28c-13d7-48fd-b533-e7a002a7949d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.005972] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.005972] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.005972] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.005972] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12b54335-eb35-490d-a8d9-d12ac5809eb9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.005972] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.006222] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.006222] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.006695] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e285eaec-686f-4ae5-a9aa-59215e24189f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.006695] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.006695] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.006695] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.006902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c4389af-195b-4eda-a15f-a441817ee12a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.006902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.007622] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.033575] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.034208] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.034208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.034208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.034431] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.034431] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.035023] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.035023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.035023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.035193] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.035193] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.035985] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.035985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.035985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.035985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.035985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.036336] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c is going to be updated. [ 797.038204] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.038204] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.171156] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.171156] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.186052] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.186332] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.186434] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.186490] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.186702] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.186818] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.187013] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 is going to be updated. [ 797.188130] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.188318] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.188406] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.188527] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85cfbc91-333d-4a17-874c-c9f26dffaadd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.188661] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.188811] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.188885] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.189047] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3654b92f-abc1-46ca-b6d3-5854c70c886e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.189166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.189319] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.189471] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.189605] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.189726] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.189905] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.189995] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.190258] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14427d59-3459-4ddd-9c42-78877a31172d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.190723] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.190933] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.246748] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.246801] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.246863] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.246948] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.247157] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.247341] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.247504] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 752cf951-e22b-4bfc-b89a-6766804d295f is going to be updated. [ 797.248668] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.248858] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.248947] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.249097] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29c3066f-92d6-4fd9-a20b-96651c82bc4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.257167] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c81f8cb-609b-4496-9f07-b80abbe519f8: rpc.has_security_group_logging(os_id): False [ 797.267142] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.267323] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.267385] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.267574] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.267666] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.267782] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4233009-fbd8-4936-abda-bc37e3d37b55" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.273176] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9943d881-28bf-4885-906c-d360f9c2c3e7: rpc.has_security_group_logging(os_id): False [ 797.273466] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0010338f-67e3-417c-be88-4e0a85ad75aa: rpc.has_security_group_logging(os_id): False [ 797.297786] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.297786] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.297902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.298092] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.298285] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.306668] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.306822] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.306895] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.307196] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.309105] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-177e22b5-9104-44ad-8e54-e2d4da7915c9 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.309283] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.309390] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.309659] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.309842] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.309945] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.310010] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.310291] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.310291] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.310394] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.310469] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-177e22b5-9104-44ad-8e54-e2d4da7915c9 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.310564] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.310623] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.310762] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.310899] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.310984] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.311053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.311189] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.311438] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.311438] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.311560] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('177e22b5-9104-44ad-8e54-e2d4da7915c9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.344212] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.344391] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.345320] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.345426] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.355326] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.355326] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.355326] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.355517] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.355556] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.355622] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.355895] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.356635] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.356635] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.356635] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.356635] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.356635] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.356635] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.356888] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.356888] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.357030] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.357030] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0010338f-67e3-417c-be88-4e0a85ad75aa is going to be updated. [ 797.359415] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.359618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.363284] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.363284] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.376803] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c in Status: IN_PROGRESS for 2s [ 797.420645] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.420790] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.428147] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.428147] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.428147] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.428147] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.428147] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.430324] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.430324] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 is going to be updated. [ 797.430324] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.430324] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.480654] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.480953] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.481127] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.481199] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.481709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.481709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.481896] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.481896] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.482036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.482194] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.482290] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.482476] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.482623] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.482623] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.482804] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.482885] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.482952] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 is going to be updated. [ 797.484143] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.484635] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.484635] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.485603] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.485811] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.485949] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.527027] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 752cf951-e22b-4bfc-b89a-6766804d295f in Status: IN_PROGRESS for 2s [ 797.527027] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 in Status: IN_PROGRESS for 2s [ 797.583547] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.583767] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.583863] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.584133] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.584292] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.623231] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.623431] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.623485] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.623765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.623913] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.628573] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0010338f-67e3-417c-be88-4e0a85ad75aa in Status: IN_PROGRESS for 2s [ 797.641924] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: IN_PROGRESS for 2s [ 797.652882] env[65783]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 797.653468] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.653631] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.653699] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.653975] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.654143] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.706907] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: IN_PROGRESS for 2s [ 797.814113] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 177e22b5-9104-44ad-8e54-e2d4da7915c9: rpc.has_security_group_logging(os_id): False [ 797.840766] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.840961] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.840961] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.841224] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.841324] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.841585] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.841690] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.841751] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.841902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.841981] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.842170] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.842263] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.842317] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.842497] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.842569] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.842758] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.842852] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.842905] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.843139] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.843221] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.843307] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 is going to be updated. [ 797.948413] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.948635] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.948635] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.948856] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.949059] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.962938] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 in Status: IN_PROGRESS for 2s [ 798.436318] env[65783]: INFO networking_nsxv3.common.synchronization [None req-fec06030-a0d3-4e0e-9bf0-8bdbd1af62e5 None None] Enqueued Resource ID: 358d1907-d7c2-4e3f-8c83-5bfd62f07648 with Priority: HIGHEST for action port [ 798.436898] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 358d1907-d7c2-4e3f-8c83-5bfd62f07648 with Priority: HIGHEST for action port [ 798.437195] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-358d1907-d7c2-4e3f-8c83-5bfd62f07648 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.437326] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-358d1907-d7c2-4e3f-8c83-5bfd62f07648" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.437380] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-358d1907-d7c2-4e3f-8c83-5bfd62f07648" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.437640] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-358d1907-d7c2-4e3f-8c83-5bfd62f07648" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.437724] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('358d1907-d7c2-4e3f-8c83-5bfd62f07648',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.939570] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 358d1907-d7c2-4e3f-8c83-5bfd62f07648 [ 798.939854] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.939935] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.939990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.940653] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.940653] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.940653] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:358d1907-d7c2-4e3f-8c83-5bfd62f07648 already deleted. [ 798.940653] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-358d1907-d7c2-4e3f-8c83-5bfd62f07648" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.394099] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c in Status: SUCCESS [ 799.394822] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.543178] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 in Status: SUCCESS [ 799.543406] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.544179] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 752cf951-e22b-4bfc-b89a-6766804d295f in Status: SUCCESS [ 799.544459] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.642581] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0010338f-67e3-417c-be88-4e0a85ad75aa in Status: SUCCESS [ 799.645876] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.654085] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: SUCCESS [ 799.654360] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.723134] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: SUCCESS [ 799.723520] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.979747] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 in Status: SUCCESS [ 799.979747] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.789893] env[65783]: INFO networking_nsxv3.common.synchronization [None req-7cafdd48-41d1-467d-a831-125e9e99e923 tempest-ServerRescueNegativeTestJSON-1644419569 tempest-ServerRescueNegativeTestJSON-1644419569-project-member] Enqueued Resource ID: bbaf974c-75cf-4b48-a666-f75dfe105a74 with Priority: HIGHEST for action security_group_rules [ 800.790466] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaf974c-75cf-4b48-a666-f75dfe105a74 with Priority: HIGHEST for action security_group_rules [ 800.790964] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbaf974c-75cf-4b48-a666-f75dfe105a74 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.790964] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.790964] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.792983] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.793092] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbaf974c-75cf-4b48-a666-f75dfe105a74',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.924251] env[65783]: INFO networking_nsxv3.common.synchronization [None req-511561fc-6c3b-4357-9101-fe310e74c1f6 tempest-ServerRescueNegativeTestJSON-1644419569 tempest-ServerRescueNegativeTestJSON-1644419569-project-member] Enqueued Resource ID: bbaf974c-75cf-4b48-a666-f75dfe105a74 with Priority: HIGHEST for action security_group_rules [ 800.925026] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaf974c-75cf-4b48-a666-f75dfe105a74 with Priority: HIGHEST for action security_group_rules [ 800.925411] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbaf974c-75cf-4b48-a666-f75dfe105a74 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.925574] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.315729] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.316098] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.316098] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.316643] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.316643] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.316643] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbaf974c-75cf-4b48-a666-f75dfe105a74 already deleted. [ 801.316643] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.316643] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.316943] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.317047] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbaf974c-75cf-4b48-a666-f75dfe105a74',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.839785] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.839939] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.840023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.840245] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.840333] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.840467] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbaf974c-75cf-4b48-a666-f75dfe105a74 already deleted. [ 801.840586] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.926373] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 805.926727] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 806.171257] env[65783]: INFO networking_nsxv3.common.synchronization [req-e5a9e8e0-de6b-48b7-9bdb-b41f328486d2 req-450d980c-aaa5-465b-9478-240731e5a333 tempest-DeleteServersTestJSON-1456685968 tempest-DeleteServersTestJSON-1456685968-project-member] Enqueued Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 806.171558] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 806.171921] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.172019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.172065] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.172417] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.172609] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.172730] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.172788] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.172932] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.173033] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.173126] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.652067] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-131 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.652274] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-131" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.652439] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-131" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.652789] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-131" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.653104] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.653272] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.653380] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.653595] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.653795] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.654041] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 806.654155] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 806.654260] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 806.654361] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 806.654465] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 806.654565] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 806.655650] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 806.675515] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.675789] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.675929] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.676119] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.676219] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.676421] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.676531] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.676608] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.676741] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.676812] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.676896] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 already deleted. [ 806.676972] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.679292] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 806.679585] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 806.679819] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 806.680000] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-131" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.680911] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-29e1dcd1-5465-47b7-929e-de731202dbd0 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.680911] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-29e1dcd1-5465-47b7-929e-de731202dbd0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.680911] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-29e1dcd1-5465-47b7-929e-de731202dbd0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.681683] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-29e1dcd1-5465-47b7-929e-de731202dbd0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.682186] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29e1dcd1-5465-47b7-929e-de731202dbd0',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.184482] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.184769] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.184978] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.185332] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.185533] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.185717] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 29e1dcd1-5465-47b7-929e-de731202dbd0 not found, creating... [ 807.186018] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.186238] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.186518] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.186707] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.186888] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.188051] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.188200] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.188293] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.188489] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.188624] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.188761] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 29e1dcd1-5465-47b7-929e-de731202dbd0 is going to be created. [ 807.217889] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.218681] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.218681] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.218681] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.218864] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.219098] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-29e1dcd1-5465-47b7-929e-de731202dbd0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.075263] env[65783]: INFO networking_nsxv3.common.synchronization [req-e5a9e8e0-de6b-48b7-9bdb-b41f328486d2 req-faa3a055-2fd5-47d7-bbef-53abf32a83d2 service nova] Enqueued Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_rules [ 808.075263] env[65783]: INFO networking_nsxv3.common.synchronization [req-e5a9e8e0-de6b-48b7-9bdb-b41f328486d2 req-faa3a055-2fd5-47d7-bbef-53abf32a83d2 service nova] Enqueued Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 808.075263] env[65783]: INFO networking_nsxv3.common.synchronization [req-e5a9e8e0-de6b-48b7-9bdb-b41f328486d2 req-faa3a055-2fd5-47d7-bbef-53abf32a83d2 service nova] Enqueued Resource ID: 29e1dcd1-5465-47b7-929e-de731202dbd0 with Priority: HIGHEST for action port [ 808.075263] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_rules [ 808.075263] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 808.075263] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29e1dcd1-5465-47b7-929e-de731202dbd0 with Priority: HIGHEST for action port [ 808.075263] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.075263] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.075263] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.075263] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.075263] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.075694] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.075694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.075694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.075850] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.075929] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.076025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.076086] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.076221] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.076291] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.077227] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.078881] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-29e1dcd1-5465-47b7-929e-de731202dbd0 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.078881] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29e1dcd1-5465-47b7-929e-de731202dbd0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.078881] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29e1dcd1-5465-47b7-929e-de731202dbd0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.078881] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29e1dcd1-5465-47b7-929e-de731202dbd0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.078881] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29e1dcd1-5465-47b7-929e-de731202dbd0',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.579867] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.580222] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.580222] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.581434] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 29e1dcd1-5465-47b7-929e-de731202dbd0 with status ACTIVE [ 808.581655] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.581786] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.581916] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.582097] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.582466] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.582466] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.582466] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.582724] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.582724] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.583593] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.585327] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.585327] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.585327] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.585327] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.585327] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.585327] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 29e1dcd1-5465-47b7-929e-de731202dbd0 is going to be updated. [ 808.612636] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.612771] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.612841] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.613075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.613208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.613368] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29e1dcd1-5465-47b7-929e-de731202dbd0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.086407] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.591411] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.591411] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.591411] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.591411] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.591411] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.591411] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 is going to be created. [ 809.624596] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.624596] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.624596] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.625342] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.629060] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.641523] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: UNINITIALIZED for 2s [ 811.655296] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: SUCCESS [ 811.655648] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.655790] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.656098] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.656379] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.656594] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.656711] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.656958] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.657094] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.657255] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.657374] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.160472] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.160652] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.160698] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.162043] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.162214] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.162332] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.162510] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.162596] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.162764] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.162867] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.162996] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.163153] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.163225] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.163386] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.163532] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.163647] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.163698] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.163860] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.163974] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.164376] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.164448] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.668725] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a56944ee-f571-421e-aac3-fe1ac51a1fd9: rpc.has_security_group_logging(os_id): False [ 812.689270] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.690178] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.690345] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.690600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.690709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.691951] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.691951] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.691951] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.691951] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.691951] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.691951] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.691951] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.691951] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.691951] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.691951] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.692990] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.692990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.692990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.692990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.692990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.692990] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 is going to be created. [ 812.759572] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.759572] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.759572] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.759572] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.759572] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.772113] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: IN_PROGRESS for 2s [ 813.075867] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 813.075867] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 814.734616] env[65783]: INFO networking_nsxv3.common.synchronization [None req-8b7d8362-0b78-411e-ad98-f744ff8b8715 None None] Enqueued Resource ID: 79b2942c-f93c-4e88-9ffe-8a59eb293267 with Priority: HIGHEST for action port [ 814.735887] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79b2942c-f93c-4e88-9ffe-8a59eb293267 with Priority: HIGHEST for action port [ 814.735887] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-79b2942c-f93c-4e88-9ffe-8a59eb293267 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.737036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79b2942c-f93c-4e88-9ffe-8a59eb293267" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.737036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79b2942c-f93c-4e88-9ffe-8a59eb293267" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.737036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79b2942c-f93c-4e88-9ffe-8a59eb293267" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.737036] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79b2942c-f93c-4e88-9ffe-8a59eb293267',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.789945] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: SUCCESS [ 814.790214] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.238930] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 79b2942c-f93c-4e88-9ffe-8a59eb293267 [ 815.239941] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.239941] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.239941] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.239941] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.239941] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.240599] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:79b2942c-f93c-4e88-9ffe-8a59eb293267 already deleted. [ 815.240811] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79b2942c-f93c-4e88-9ffe-8a59eb293267" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.243125] env[65783]: INFO networking_nsxv3.common.synchronization [req-0f1c312a-22c1-4b20-a202-7bf7b0ec00df req-66247251-99cd-4317-9a67-ebabc50ea0a1 tempest-ServersWithSpecificFlavorTestJSON-767212478 tempest-ServersWithSpecificFlavorTestJSON-767212478-project-member] Enqueued Resource ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 with Priority: HIGHEST for action security_group_members [ 815.246390] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 with Priority: HIGHEST for action security_group_members [ 815.246390] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e588ff7c-d45a-4b75-823e-f219eeb5e814 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.246390] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.246390] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.246390] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.246390] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.246390] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.246390] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.246390] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.246390] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.246390] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e588ff7c-d45a-4b75-823e-f219eeb5e814',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.608421] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-944 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.608887] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-944" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.609049] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-944" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.609354] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-944" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.610036] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.610036] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.610036] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.610336] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.610336] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.610532] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 815.610891] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 815.610986] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 815.611129] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 815.611198] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 815.611329] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 815.611409] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 815.633925] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 815.633925] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 815.633925] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 815.633925] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-944" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.633925] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-773392a6-7451-4cad-95dd-aba2407f0497 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.633925] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-773392a6-7451-4cad-95dd-aba2407f0497" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.633925] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-773392a6-7451-4cad-95dd-aba2407f0497" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.633925] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-773392a6-7451-4cad-95dd-aba2407f0497" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.633925] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('773392a6-7451-4cad-95dd-aba2407f0497',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.749043] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.749420] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.749420] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.749506] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.749595] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.749758] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.749862] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.749950] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.750268] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.750268] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.750457] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 is going to be deleted. [ 815.790275] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.790415] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.790692] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.791583] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.791728] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.791811] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.138713] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.138713] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.139178] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.139585] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.139914] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.140206] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 773392a6-7451-4cad-95dd-aba2407f0497 not found, creating... [ 816.140591] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.143023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.143023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.143023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.143023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.143023] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.143023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.143023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.143023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.143023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.143023] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 773392a6-7451-4cad-95dd-aba2407f0497 is going to be created. [ 816.168211] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.168462] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.168634] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.168987] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.170217] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.170217] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-773392a6-7451-4cad-95dd-aba2407f0497" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.891295] env[65783]: INFO networking_nsxv3.common.synchronization [req-0f1c312a-22c1-4b20-a202-7bf7b0ec00df req-c9ae9b89-350f-4121-9261-a4ddb4561dca service nova] Enqueued Resource ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 with Priority: HIGHEST for action security_group_rules [ 816.891295] env[65783]: INFO networking_nsxv3.common.synchronization [req-0f1c312a-22c1-4b20-a202-7bf7b0ec00df req-c9ae9b89-350f-4121-9261-a4ddb4561dca service nova] Enqueued Resource ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 with Priority: HIGHEST for action security_group_members [ 816.891295] env[65783]: INFO networking_nsxv3.common.synchronization [req-0f1c312a-22c1-4b20-a202-7bf7b0ec00df req-c9ae9b89-350f-4121-9261-a4ddb4561dca service nova] Enqueued Resource ID: 773392a6-7451-4cad-95dd-aba2407f0497 with Priority: HIGHEST for action port [ 816.891295] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 with Priority: HIGHEST for action security_group_rules [ 816.891295] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 with Priority: HIGHEST for action security_group_members [ 816.891295] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 773392a6-7451-4cad-95dd-aba2407f0497 with Priority: HIGHEST for action port [ 816.891295] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e588ff7c-d45a-4b75-823e-f219eeb5e814 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.891295] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.891295] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.892152] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.892152] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e588ff7c-d45a-4b75-823e-f219eeb5e814',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.895812] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e588ff7c-d45a-4b75-823e-f219eeb5e814 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.897509] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.897509] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.897509] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.897509] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.897509] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.897509] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.897509] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.897509] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.897509] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e588ff7c-d45a-4b75-823e-f219eeb5e814',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.898336] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-773392a6-7451-4cad-95dd-aba2407f0497 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.898467] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-773392a6-7451-4cad-95dd-aba2407f0497" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.898547] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-773392a6-7451-4cad-95dd-aba2407f0497" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.898753] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-773392a6-7451-4cad-95dd-aba2407f0497" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.898860] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('773392a6-7451-4cad-95dd-aba2407f0497',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.401057] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e588ff7c-d45a-4b75-823e-f219eeb5e814 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.401212] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.401419] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e588ff7c-d45a-4b75-823e-f219eeb5e814',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.402414] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 773392a6-7451-4cad-95dd-aba2407f0497 with status ACTIVE [ 817.402602] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.402758] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.402823] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.403087] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.403205] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.403424] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.403499] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.403536] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.403735] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.403771] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.403956] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.404079] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.404147] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.404292] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.404366] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.404486] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 773392a6-7451-4cad-95dd-aba2407f0497 is going to be updated. [ 817.428968] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.428968] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.428968] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.428968] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.428968] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.428968] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-773392a6-7451-4cad-95dd-aba2407f0497" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.432304] env[65783]: INFO networking_nsxv3.common.synchronization [None req-7a175ee0-f987-486e-8c98-8e4f1489aab7 None None] Enqueued Resource ID: f9450959-d781-413d-9990-df96bcb8d3e1 with Priority: HIGHEST for action port [ 817.432792] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9450959-d781-413d-9990-df96bcb8d3e1 with Priority: HIGHEST for action port [ 817.433178] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9450959-d781-413d-9990-df96bcb8d3e1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.434182] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9450959-d781-413d-9990-df96bcb8d3e1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.434182] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9450959-d781-413d-9990-df96bcb8d3e1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.434182] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9450959-d781-413d-9990-df96bcb8d3e1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.434182] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9450959-d781-413d-9990-df96bcb8d3e1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.704777] env[65783]: INFO networking_nsxv3.common.synchronization [req-85b2c6df-9eff-493c-bfc6-99a0ebde37ce req-0801ea9c-b8ff-45c0-90b7-24d95237a975 tempest-ServerActionsTestOtherA-298845163 tempest-ServerActionsTestOtherA-298845163-project-member] Enqueued Resource ID: de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb with Priority: HIGHEST for action security_group_members [ 817.704777] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb with Priority: HIGHEST for action security_group_members [ 817.705709] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.705709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.705709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.708436] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.708436] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.708436] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.708436] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.708436] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.708436] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.708436] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.907288] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e588ff7c-d45a-4b75-823e-f219eeb5e814',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.941422] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f9450959-d781-413d-9990-df96bcb8d3e1 [ 817.941782] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.941946] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.942041] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.942669] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.942669] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.942669] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f9450959-d781-413d-9990-df96bcb8d3e1 already deleted. [ 817.942669] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9450959-d781-413d-9990-df96bcb8d3e1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.066937] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-678 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.067243] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-678" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.067372] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-678" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.067625] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-678" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.068582] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.068582] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.068582] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.068582] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.068792] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.068965] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 818.069128] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 818.069263] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 818.069397] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 818.069916] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 818.069916] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 818.069916] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 818.094673] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 818.094976] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 818.095083] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 818.095996] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-678" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.095996] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-31daf1d5-0a84-4d17-a694-a7ab16e9b81b taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.095996] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-31daf1d5-0a84-4d17-a694-a7ab16e9b81b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.095996] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-31daf1d5-0a84-4d17-a694-a7ab16e9b81b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.096485] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-31daf1d5-0a84-4d17-a694-a7ab16e9b81b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.096485] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31daf1d5-0a84-4d17-a694-a7ab16e9b81b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.211277] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.211481] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.211481] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.212304] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.212304] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.212630] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.212630] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.212630] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.212771] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.213014] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.213014] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb already deleted. [ 818.213014] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.410830] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.410830] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.410830] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.410830] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.410830] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.410830] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 is going to be created. [ 818.449241] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.450149] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.450149] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.450149] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.450149] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.466065] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 in Status: UNINITIALIZED for 2s [ 818.602173] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.602173] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.602173] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.602173] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.604265] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.604394] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 31daf1d5-0a84-4d17-a694-a7ab16e9b81b not found, creating... [ 818.604661] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.604977] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.605127] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.605575] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.605814] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.606515] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.606600] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.606749] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.607064] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.607301] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.607593] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 31daf1d5-0a84-4d17-a694-a7ab16e9b81b is going to be created. [ 818.630819] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.630819] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.630819] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.630819] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.630819] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.630819] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-31daf1d5-0a84-4d17-a694-a7ab16e9b81b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.383837] env[65783]: INFO networking_nsxv3.common.synchronization [req-85b2c6df-9eff-493c-bfc6-99a0ebde37ce req-b5242fe5-f584-472d-83a0-4ba37ae1d0fd service nova] Enqueued Resource ID: de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb with Priority: HIGHEST for action security_group_rules [ 819.384132] env[65783]: INFO networking_nsxv3.common.synchronization [req-85b2c6df-9eff-493c-bfc6-99a0ebde37ce req-b5242fe5-f584-472d-83a0-4ba37ae1d0fd service nova] Enqueued Resource ID: de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb with Priority: HIGHEST for action security_group_members [ 819.384223] env[65783]: INFO networking_nsxv3.common.synchronization [req-85b2c6df-9eff-493c-bfc6-99a0ebde37ce req-b5242fe5-f584-472d-83a0-4ba37ae1d0fd service nova] Enqueued Resource ID: 31daf1d5-0a84-4d17-a694-a7ab16e9b81b with Priority: HIGHEST for action port [ 819.384895] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb with Priority: HIGHEST for action security_group_rules [ 819.384895] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb with Priority: HIGHEST for action security_group_members [ 819.385128] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31daf1d5-0a84-4d17-a694-a7ab16e9b81b with Priority: HIGHEST for action port [ 819.385353] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.385353] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.385353] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.385353] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.385353] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.387367] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.387367] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.387367] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.387367] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.387367] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.387367] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.387367] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.387367] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.387756] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.387756] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.388395] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-31daf1d5-0a84-4d17-a694-a7ab16e9b81b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.388395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31daf1d5-0a84-4d17-a694-a7ab16e9b81b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.388395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31daf1d5-0a84-4d17-a694-a7ab16e9b81b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.388572] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31daf1d5-0a84-4d17-a694-a7ab16e9b81b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.388608] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31daf1d5-0a84-4d17-a694-a7ab16e9b81b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.837896] env[65783]: INFO networking_nsxv3.common.synchronization [req-5a9b23b4-afc6-4d9c-813e-4b4cce772667 req-3bbe70cd-e1d3-46be-aceb-fe9b1554a1d7 tempest-DeleteServersTestJSON-1456685968 tempest-DeleteServersTestJSON-1456685968-project-member] Enqueued Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 819.837896] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 819.837896] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.837896] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.837896] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.838468] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.838779] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.839056] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.839243] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.839634] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.839878] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.840120] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.890250] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.890409] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.890709] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.894703] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31daf1d5-0a84-4d17-a694-a7ab16e9b81b with status ACTIVE [ 819.894703] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.894703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.894703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.894703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.894703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.894703] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.894703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.894703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.894703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.894703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.894703] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.894703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.894703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.895257] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.895257] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.895257] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31daf1d5-0a84-4d17-a694-a7ab16e9b81b is going to be updated. [ 819.919650] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.919802] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.919857] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.920432] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.920432] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.920432] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31daf1d5-0a84-4d17-a694-a7ab16e9b81b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.342625] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.342896] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.342967] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.343169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.343255] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.343452] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.343549] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.343605] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.343748] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.343821] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.343927] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 is going to be updated. [ 820.370164] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.370323] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.370370] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.370582] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.370724] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.381888] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: IN_PROGRESS for 2s [ 820.397331] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.475309] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 in Status: SUCCESS [ 820.475630] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.475790] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.476014] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.476205] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.476316] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.476377] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.476525] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.476599] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.476681] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.476774] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e588ff7c-d45a-4b75-823e-f219eeb5e814',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.899767] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.900086] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.900207] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.900461] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.900558] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.900870] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb is going to be created. [ 820.935104] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.935240] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.935390] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.935535] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.935742] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.949422] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb in Status: UNINITIALIZED for 2s [ 820.979151] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e588ff7c-d45a-4b75-823e-f219eeb5e814',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.483601] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e588ff7c-d45a-4b75-823e-f219eeb5e814: rpc.has_security_group_logging(os_id): False [ 821.500412] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.502459] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.502459] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.502459] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.502783] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.502827] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.502912] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.502980] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.503138] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.503216] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.503301] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 is going to be created. [ 821.591440] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.591708] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.591873] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.592202] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.592405] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.607343] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 in Status: IN_PROGRESS for 2s [ 822.396575] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: SUCCESS [ 822.396717] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 deletion is rescheduled due to dependency. [ 822.396835] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.994752] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb in Status: SUCCESS [ 822.995397] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.995469] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.995816] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.996167] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.996432] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.996725] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.997159] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.997479] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.997664] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.997830] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.501966] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.623666] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 in Status: SUCCESS [ 823.623666] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.004910] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb: rpc.has_security_group_logging(os_id): False [ 824.026047] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.026047] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.026047] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.026047] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.026047] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.026047] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.026047] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.026047] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.026047] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.026047] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.026047] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb is going to be created. [ 824.086037] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.086171] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.086171] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.086989] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.086989] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.098539] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb in Status: IN_PROGRESS for 2s [ 824.838202] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 824.838397] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 825.687998] env[65783]: INFO networking_nsxv3.common.synchronization [req-fb5d5c00-bf03-45c3-9646-f105b458f069 req-d87ecadd-380b-4cf3-a6f8-494db6492613 tempest-ImagesTestJSON-433702528 tempest-ImagesTestJSON-433702528-project-member] Enqueued Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 825.687998] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 825.688592] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.688968] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.689532] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.691896] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.691896] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.691896] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.691896] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.691896] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.691896] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.691896] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.826726] env[65783]: INFO networking_nsxv3.common.synchronization [None req-f28e4e82-6fc4-4e5e-8a2b-468d6cf28e58 None None] Enqueued Resource ID: 38be1e99-e0fe-4ad8-b02e-e488ea339197 with Priority: HIGHEST for action port [ 825.827267] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38be1e99-e0fe-4ad8-b02e-e488ea339197 with Priority: HIGHEST for action port [ 825.827586] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-38be1e99-e0fe-4ad8-b02e-e488ea339197 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.827714] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38be1e99-e0fe-4ad8-b02e-e488ea339197" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.827780] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38be1e99-e0fe-4ad8-b02e-e488ea339197" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.828771] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38be1e99-e0fe-4ad8-b02e-e488ea339197" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.828771] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38be1e99-e0fe-4ad8-b02e-e488ea339197',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.076116] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-509 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.076425] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-509" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.076645] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-509" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.077100] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-509" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.077521] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.077785] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.078009] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.078415] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.078655] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.078976] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 826.079180] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 826.079364] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 826.079561] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 826.079721] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 826.079837] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 826.079974] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 826.102095] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 826.102271] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 826.102407] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 826.102637] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-509" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.103820] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-ef83244d-23de-4589-bab0-ea354e648ac2 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.103820] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-ef83244d-23de-4589-bab0-ea354e648ac2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.103820] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-ef83244d-23de-4589-bab0-ea354e648ac2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.103820] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-ef83244d-23de-4589-bab0-ea354e648ac2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.103820] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef83244d-23de-4589-bab0-ea354e648ac2',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.116454] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb in Status: SUCCESS [ 826.117338] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.194110] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.194277] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.194365] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.194574] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.194708] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.194850] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.194950] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.195022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.195162] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.195700] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.195700] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd942bf-b305-4707-8084-1ac6b135c741 is going to be deleted. [ 826.229768] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.229964] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.230187] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.230338] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.230397] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.230529] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.336051] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 38be1e99-e0fe-4ad8-b02e-e488ea339197 [ 826.337224] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.337364] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.337430] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.337646] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.337736] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.338960] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:38be1e99-e0fe-4ad8-b02e-e488ea339197 already deleted. [ 826.338960] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38be1e99-e0fe-4ad8-b02e-e488ea339197" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.607717] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.608053] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.608189] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.608472] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.608634] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.608766] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port ef83244d-23de-4589-bab0-ea354e648ac2 not found, creating... [ 826.609051] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.609199] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.609347] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.609550] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.609720] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.610023] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.610180] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.610293] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.610500] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.610644] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.610757] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: ef83244d-23de-4589-bab0-ea354e648ac2 is going to be created. [ 826.631907] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.632197] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.632300] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.632500] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.632737] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.632968] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-ef83244d-23de-4589-bab0-ea354e648ac2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.445848] env[65783]: INFO networking_nsxv3.common.synchronization [req-fb5d5c00-bf03-45c3-9646-f105b458f069 req-d580599e-811f-4238-aee5-73993f331254 service nova] Enqueued Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_rules [ 827.446172] env[65783]: INFO networking_nsxv3.common.synchronization [req-fb5d5c00-bf03-45c3-9646-f105b458f069 req-d580599e-811f-4238-aee5-73993f331254 service nova] Enqueued Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 827.446172] env[65783]: INFO networking_nsxv3.common.synchronization [req-fb5d5c00-bf03-45c3-9646-f105b458f069 req-d580599e-811f-4238-aee5-73993f331254 service nova] Enqueued Resource ID: ef83244d-23de-4589-bab0-ea354e648ac2 with Priority: HIGHEST for action port [ 827.447320] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_rules [ 827.447488] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 827.447631] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef83244d-23de-4589-bab0-ea354e648ac2 with Priority: HIGHEST for action port [ 827.447924] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.449033] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.449113] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.449394] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.449554] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.450818] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.450818] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.450928] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.451286] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.451474] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.451619] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.451681] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.451868] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.451963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.452061] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.452983] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef83244d-23de-4589-bab0-ea354e648ac2 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.453189] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef83244d-23de-4589-bab0-ea354e648ac2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.453189] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef83244d-23de-4589-bab0-ea354e648ac2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.453358] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef83244d-23de-4589-bab0-ea354e648ac2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.453401] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef83244d-23de-4589-bab0-ea354e648ac2',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.956024] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.956334] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.956621] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.957627] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ef83244d-23de-4589-bab0-ea354e648ac2 with status ACTIVE [ 827.957830] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.957942] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.958110] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.958251] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.958346] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.958532] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.958636] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.958691] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.958834] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.958904] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.959675] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.959819] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.959889] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.960118] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.963170] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.963170] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ef83244d-23de-4589-bab0-ea354e648ac2 is going to be updated. [ 828.007116] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.007116] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.007116] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.007116] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.007116] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.007116] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef83244d-23de-4589-bab0-ea354e648ac2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.463967] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.710150] env[65783]: INFO networking_nsxv3.common.synchronization [None req-58dbe614-2f6f-4357-8a95-51a28e81da19 None None] Enqueued Resource ID: a37ff6d1-3689-4280-9d5d-5c24b46d6bd5 with Priority: HIGHEST for action port [ 828.710952] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a37ff6d1-3689-4280-9d5d-5c24b46d6bd5 with Priority: HIGHEST for action port [ 828.710952] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-a37ff6d1-3689-4280-9d5d-5c24b46d6bd5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.711115] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a37ff6d1-3689-4280-9d5d-5c24b46d6bd5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.711115] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a37ff6d1-3689-4280-9d5d-5c24b46d6bd5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.711348] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a37ff6d1-3689-4280-9d5d-5c24b46d6bd5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.711484] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a37ff6d1-3689-4280-9d5d-5c24b46d6bd5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.967503] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.967675] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.967752] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.968185] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.968185] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.968185] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd942bf-b305-4707-8084-1ac6b135c741 is going to be created. [ 828.997717] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.997893] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.997957] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.998149] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.998295] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.011024] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: UNINITIALIZED for 2s [ 829.215408] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a37ff6d1-3689-4280-9d5d-5c24b46d6bd5 [ 829.215695] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.215793] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.215857] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.216134] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.216274] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.216323] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a37ff6d1-3689-4280-9d5d-5c24b46d6bd5 already deleted. [ 829.216391] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a37ff6d1-3689-4280-9d5d-5c24b46d6bd5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.022634] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: SUCCESS [ 831.022972] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.023083] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.023268] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.023458] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.023574] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.023648] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.023905] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.023905] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.024023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.024023] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.526742] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.526911] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.526972] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.527224] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.527395] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.527499] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.527559] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.527705] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.527783] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.527863] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.528014] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.528113] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.528169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.528301] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.528442] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.528526] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.528581] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.528825] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.528825] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.528942] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.528942] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.034718] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for efd942bf-b305-4707-8084-1ac6b135c741: rpc.has_security_group_logging(os_id): False [ 832.057182] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.057440] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.057440] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.057644] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.057749] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.057975] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.058133] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.058133] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.058304] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.058376] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.058529] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.058664] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.058664] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.058812] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.058885] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.059540] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.059739] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.059837] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.060026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.060135] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.060804] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efd942bf-b305-4707-8084-1ac6b135c741 is going to be created. [ 832.138705] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.138705] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.138705] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.138705] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.138705] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.154196] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: IN_PROGRESS for 2s [ 833.712489] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 833.713045] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 834.170709] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: SUCCESS [ 834.170917] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.879243] env[65783]: INFO networking_nsxv3.common.synchronization [req-5b63f097-9d17-48c2-a4bf-a31b34794ec0 req-33d26708-9ae8-45a9-b793-0bf796000b63 tempest-ServersAdminTestJSON-345343376 tempest-ServersAdminTestJSON-345343376-project-member] Enqueued Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_members [ 835.879858] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_members [ 835.880228] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca99b1a6-3702-4011-942b-06036fda2165 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.880817] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.880928] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.881175] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.881450] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.881635] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.881749] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.881936] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.882073] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.882197] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.384285] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.886598] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.390083] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.390243] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.390437] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.390598] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.390635] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.390708] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca99b1a6-3702-4011-942b-06036fda2165 is going to be updated. [ 837.431285] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.431285] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.431285] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.431285] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.431285] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.452999] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: IN_PROGRESS for 2s [ 839.466311] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: SUCCESS [ 839.466682] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.002315] env[65783]: INFO networking_nsxv3.common.synchronization [None req-adcea62e-29b1-4b1e-8390-673ff8ae34df None None] Enqueued Resource ID: 727ca71a-6afb-4254-b1db-24eb51654ce2 with Priority: HIGHEST for action port [ 840.002315] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 727ca71a-6afb-4254-b1db-24eb51654ce2 with Priority: HIGHEST for action port [ 840.003670] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-727ca71a-6afb-4254-b1db-24eb51654ce2 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.003778] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-727ca71a-6afb-4254-b1db-24eb51654ce2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.003778] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-727ca71a-6afb-4254-b1db-24eb51654ce2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.004093] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-727ca71a-6afb-4254-b1db-24eb51654ce2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.004186] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('727ca71a-6afb-4254-b1db-24eb51654ce2',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.506922] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 727ca71a-6afb-4254-b1db-24eb51654ce2 [ 840.507207] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.507345] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.507414] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.507633] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.507718] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.507811] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:727ca71a-6afb-4254-b1db-24eb51654ce2 already deleted. [ 840.507892] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-727ca71a-6afb-4254-b1db-24eb51654ce2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.819019] env[65783]: INFO networking_nsxv3.common.synchronization [req-e4cf0021-051c-44ac-8afb-8ae12bf004ec req-df3f87b5-e901-42c9-8b42-9b1657c74ea8 tempest-ServersAdminNegativeTestJSON-2089691366 tempest-ServersAdminNegativeTestJSON-2089691366-project-member] Enqueued Resource ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c with Priority: HIGHEST for action security_group_members [ 840.819359] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c with Priority: HIGHEST for action security_group_members [ 840.826101] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5516de4-7ca8-423d-ae28-4654dc2ae29c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.826101] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.826101] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.826101] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.826101] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.826101] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.826101] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.826101] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.826101] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.826101] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5516de4-7ca8-423d-ae28-4654dc2ae29c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.324296] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.324550] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.324550] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.325449] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.325449] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.325449] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.325449] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.325449] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.325449] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.325449] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.325449] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c is going to be updated. [ 841.358152] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.358344] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.358421] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.358847] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.358847] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.368647] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c in Status: IN_PROGRESS for 2s [ 842.240995] env[65783]: INFO networking_nsxv3.common.synchronization [req-6a540691-f78e-4243-90cd-2cabf37e61fb req-b8b2de0e-5974-4b36-acf0-8db818f6d5f5 tempest-ServerActionsV293TestJSON-1619444112 tempest-ServerActionsV293TestJSON-1619444112-project-member] Enqueued Resource ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 with Priority: HIGHEST for action security_group_members [ 842.240995] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 with Priority: HIGHEST for action security_group_members [ 842.240995] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-d62819d6-c7c5-47a8-a028-a438cb9528b5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.240995] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.240995] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.240995] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.241490] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.241490] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.241490] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.241490] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.241490] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.241667] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d62819d6-c7c5-47a8-a028-a438cb9528b5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.569332] env[65783]: INFO networking_nsxv3.common.synchronization [None req-3189f5e5-edc2-4f1e-89f8-56bdb50569fc None None] Enqueued Resource ID: 3f74fe9c-ce7f-4b3f-b847-9d2db75a8238 with Priority: HIGHEST for action port [ 842.569716] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f74fe9c-ce7f-4b3f-b847-9d2db75a8238 with Priority: HIGHEST for action port [ 842.570864] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f74fe9c-ce7f-4b3f-b847-9d2db75a8238 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.570864] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f74fe9c-ce7f-4b3f-b847-9d2db75a8238" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.571274] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f74fe9c-ce7f-4b3f-b847-9d2db75a8238" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.571883] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f74fe9c-ce7f-4b3f-b847-9d2db75a8238" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.571883] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f74fe9c-ce7f-4b3f-b847-9d2db75a8238',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.748297] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.748297] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.748297] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.748297] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.748297] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.748297] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.748297] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.748297] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.748297] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.748297] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.748297] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 is going to be updated. [ 842.775492] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.775492] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.775492] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.775492] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.775492] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.787200] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 in Status: IN_PROGRESS for 2s [ 843.074926] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f74fe9c-ce7f-4b3f-b847-9d2db75a8238 [ 843.078227] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.078227] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.078227] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.078227] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.078227] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.078227] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f74fe9c-ce7f-4b3f-b847-9d2db75a8238 already deleted. [ 843.078227] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f74fe9c-ce7f-4b3f-b847-9d2db75a8238" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.380809] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c in Status: SUCCESS [ 843.380809] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c deletion is rescheduled due to dependency. [ 843.380809] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.418215] env[65783]: INFO networking_nsxv3.common.synchronization [req-21953979-9ae6-4c6e-993a-4539459218c2 req-e7a376af-f440-47b8-ad89-1e7f0fee3ba2 tempest-ServersNegativeTestJSON-460036087 tempest-ServersNegativeTestJSON-460036087-project-member] Enqueued Resource ID: a938b55d-b711-4079-9f7b-f27235895480 with Priority: HIGHEST for action security_group_members [ 843.418930] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a938b55d-b711-4079-9f7b-f27235895480 with Priority: HIGHEST for action security_group_members [ 843.419322] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a938b55d-b711-4079-9f7b-f27235895480 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.419480] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.419531] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.420121] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.420292] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.420401] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.420514] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.420627] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.420779] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.420838] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.843917] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-403 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.843917] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-403" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.843917] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-403" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.843917] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-403" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.843917] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.843917] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.844240] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.844240] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.844806] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.844806] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 843.844806] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 843.844806] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 843.845028] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 843.845072] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 843.845187] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 843.845316] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 843.871205] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 843.871409] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 843.871505] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 843.871686] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-403" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.872118] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-2cd6eb89-f768-4ee6-93a2-386b83c42638 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.872306] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-2cd6eb89-f768-4ee6-93a2-386b83c42638" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.872472] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-2cd6eb89-f768-4ee6-93a2-386b83c42638" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.872793] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-2cd6eb89-f768-4ee6-93a2-386b83c42638" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.872957] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cd6eb89-f768-4ee6-93a2-386b83c42638',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.923404] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.923583] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.923640] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.923827] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.923939] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.924162] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.924275] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.924339] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.924476] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.924542] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.924634] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a938b55d-b711-4079-9f7b-f27235895480 already deleted. [ 843.924749] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.376659] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.376948] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.377091] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.380087] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.380087] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.380087] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 2cd6eb89-f768-4ee6-93a2-386b83c42638 not found, creating... [ 844.380087] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.380087] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.380087] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.380087] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.380087] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.380087] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.380087] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.380615] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.380615] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.380615] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.380615] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 2cd6eb89-f768-4ee6-93a2-386b83c42638 is going to be created. [ 844.406754] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.407068] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.407228] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.407481] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.408180] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.408180] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-2cd6eb89-f768-4ee6-93a2-386b83c42638" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.798992] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 in Status: SUCCESS [ 844.799195] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 deletion is rescheduled due to dependency. [ 844.799248] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.207748] env[65783]: INFO networking_nsxv3.common.synchronization [req-21953979-9ae6-4c6e-993a-4539459218c2 req-2a369e6e-8813-4464-a1e6-0dc52a2e367f service nova] Enqueued Resource ID: a938b55d-b711-4079-9f7b-f27235895480 with Priority: HIGHEST for action security_group_rules [ 845.207931] env[65783]: INFO networking_nsxv3.common.synchronization [req-21953979-9ae6-4c6e-993a-4539459218c2 req-2a369e6e-8813-4464-a1e6-0dc52a2e367f service nova] Enqueued Resource ID: a938b55d-b711-4079-9f7b-f27235895480 with Priority: HIGHEST for action security_group_members [ 845.208080] env[65783]: INFO networking_nsxv3.common.synchronization [req-21953979-9ae6-4c6e-993a-4539459218c2 req-2a369e6e-8813-4464-a1e6-0dc52a2e367f service nova] Enqueued Resource ID: 2cd6eb89-f768-4ee6-93a2-386b83c42638 with Priority: HIGHEST for action port [ 845.208610] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a938b55d-b711-4079-9f7b-f27235895480 with Priority: HIGHEST for action security_group_rules [ 845.208758] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a938b55d-b711-4079-9f7b-f27235895480 with Priority: HIGHEST for action security_group_members [ 845.208846] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cd6eb89-f768-4ee6-93a2-386b83c42638 with Priority: HIGHEST for action port [ 845.210860] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a938b55d-b711-4079-9f7b-f27235895480 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.211096] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.211360] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.211681] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.212233] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.213371] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a938b55d-b711-4079-9f7b-f27235895480 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.213513] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.213561] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.214156] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.214156] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.214156] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.214338] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.214566] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.214566] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.214645] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.220041] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cd6eb89-f768-4ee6-93a2-386b83c42638 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.220200] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cd6eb89-f768-4ee6-93a2-386b83c42638" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.220254] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cd6eb89-f768-4ee6-93a2-386b83c42638" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.220421] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cd6eb89-f768-4ee6-93a2-386b83c42638" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.220840] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cd6eb89-f768-4ee6-93a2-386b83c42638',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.722789] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.723462] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a938b55d-b711-4079-9f7b-f27235895480 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.723658] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.724494] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2cd6eb89-f768-4ee6-93a2-386b83c42638 with status ACTIVE [ 845.724494] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.724494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.724494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.724494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.724494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.724805] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.724805] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.724805] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.724923] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.724923] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.725559] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.725559] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.725559] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.725559] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.725559] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.725559] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2cd6eb89-f768-4ee6-93a2-386b83c42638 is going to be updated. [ 845.751206] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.751359] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.751414] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.751629] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.751770] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.751949] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cd6eb89-f768-4ee6-93a2-386b83c42638" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.228079] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.680611] env[65783]: INFO networking_nsxv3.common.synchronization [req-2392569e-2a65-4a3e-9c03-d70004d602e6 req-7253c9eb-aca7-4968-9fdf-87a43ac49156 tempest-ServerRescueNegativeTestJSON-1644419569 tempest-ServerRescueNegativeTestJSON-1644419569-project-member] Enqueued Resource ID: bbaf974c-75cf-4b48-a666-f75dfe105a74 with Priority: HIGHEST for action security_group_members [ 846.681263] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaf974c-75cf-4b48-a666-f75dfe105a74 with Priority: HIGHEST for action security_group_members [ 846.681583] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaf974c-75cf-4b48-a666-f75dfe105a74 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.681688] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.681770] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.682102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.682329] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.682459] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.682523] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.683104] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.683104] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.683104] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbaf974c-75cf-4b48-a666-f75dfe105a74',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.730800] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.731182] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.731253] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.731416] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.731501] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.731608] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a938b55d-b711-4079-9f7b-f27235895480 is going to be created. [ 846.767346] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.767704] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.767704] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.768143] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.768143] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.777720] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a938b55d-b711-4079-9f7b-f27235895480 in Status: UNINITIALIZED for 2s [ 847.183713] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-863 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.183953] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-863" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.184099] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-863" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.184323] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-863" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.184583] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.184736] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.185151] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.185622] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.185775] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.186679] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 847.186679] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 847.186679] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 847.186941] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 847.186941] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 847.186941] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 847.187210] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 847.188502] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.188642] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.188714] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.188836] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.188915] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.189232] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.189347] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.189423] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.189555] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.189636] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.189709] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbaf974c-75cf-4b48-a666-f75dfe105a74 already deleted. [ 847.189847] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.213978] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 847.214176] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 847.214301] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 847.214494] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-863" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.214891] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-27626e1a-51fe-4f5a-9b93-8ab4c1b8b694 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.215051] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-27626e1a-51fe-4f5a-9b93-8ab4c1b8b694" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.215189] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-27626e1a-51fe-4f5a-9b93-8ab4c1b8b694" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.215529] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-27626e1a-51fe-4f5a-9b93-8ab4c1b8b694" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.215676] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27626e1a-51fe-4f5a-9b93-8ab4c1b8b694',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.719007] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.719640] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.719816] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.720173] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.720322] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.720478] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 27626e1a-51fe-4f5a-9b93-8ab4c1b8b694 not found, creating... [ 847.720741] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.720904] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.721043] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.721264] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.721451] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.721755] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.721939] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.722069] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.722277] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.722407] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.722541] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 27626e1a-51fe-4f5a-9b93-8ab4c1b8b694 is going to be created. [ 847.747115] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.747115] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.747115] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.747115] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.747115] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.747115] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-27626e1a-51fe-4f5a-9b93-8ab4c1b8b694" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.823800] env[65783]: INFO networking_nsxv3.common.synchronization [None req-8e397cf4-bc1c-4a58-bf53-cd9110b00c08 None None] Enqueued Resource ID: d191e6c5-57c1-4df7-a62f-868f016a6f8c with Priority: HIGHEST for action port [ 847.823800] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d191e6c5-57c1-4df7-a62f-868f016a6f8c with Priority: HIGHEST for action port [ 847.823800] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-d191e6c5-57c1-4df7-a62f-868f016a6f8c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.823800] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d191e6c5-57c1-4df7-a62f-868f016a6f8c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.823800] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d191e6c5-57c1-4df7-a62f-868f016a6f8c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.823800] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d191e6c5-57c1-4df7-a62f-868f016a6f8c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.823800] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d191e6c5-57c1-4df7-a62f-868f016a6f8c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.326869] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d191e6c5-57c1-4df7-a62f-868f016a6f8c [ 848.327112] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.327254] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.327342] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.327579] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.330142] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.330142] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d191e6c5-57c1-4df7-a62f-868f016a6f8c already deleted. [ 848.330142] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d191e6c5-57c1-4df7-a62f-868f016a6f8c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.461317] env[65783]: INFO networking_nsxv3.common.synchronization [req-2392569e-2a65-4a3e-9c03-d70004d602e6 req-c945b33d-8bd1-4ea1-bf53-a5454e9423ec service nova] Enqueued Resource ID: bbaf974c-75cf-4b48-a666-f75dfe105a74 with Priority: HIGHEST for action security_group_rules [ 848.461830] env[65783]: INFO networking_nsxv3.common.synchronization [req-2392569e-2a65-4a3e-9c03-d70004d602e6 req-c945b33d-8bd1-4ea1-bf53-a5454e9423ec service nova] Enqueued Resource ID: bbaf974c-75cf-4b48-a666-f75dfe105a74 with Priority: HIGHEST for action security_group_members [ 848.461830] env[65783]: INFO networking_nsxv3.common.synchronization [req-2392569e-2a65-4a3e-9c03-d70004d602e6 req-c945b33d-8bd1-4ea1-bf53-a5454e9423ec service nova] Enqueued Resource ID: 27626e1a-51fe-4f5a-9b93-8ab4c1b8b694 with Priority: HIGHEST for action port [ 848.468401] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaf974c-75cf-4b48-a666-f75dfe105a74 with Priority: HIGHEST for action security_group_rules [ 848.468560] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaf974c-75cf-4b48-a666-f75dfe105a74 with Priority: HIGHEST for action security_group_members [ 848.468656] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27626e1a-51fe-4f5a-9b93-8ab4c1b8b694 with Priority: HIGHEST for action port [ 848.469403] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbaf974c-75cf-4b48-a666-f75dfe105a74 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.471249] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.471249] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.471249] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.471249] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbaf974c-75cf-4b48-a666-f75dfe105a74',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.471249] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaf974c-75cf-4b48-a666-f75dfe105a74 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.471249] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.471249] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.471842] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.471842] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.471842] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.471842] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.471842] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.471842] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.473990] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbaf974c-75cf-4b48-a666-f75dfe105a74',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.473990] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-27626e1a-51fe-4f5a-9b93-8ab4c1b8b694 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.473990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27626e1a-51fe-4f5a-9b93-8ab4c1b8b694" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.475913] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27626e1a-51fe-4f5a-9b93-8ab4c1b8b694" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.475913] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27626e1a-51fe-4f5a-9b93-8ab4c1b8b694" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.475913] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27626e1a-51fe-4f5a-9b93-8ab4c1b8b694',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.789914] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a938b55d-b711-4079-9f7b-f27235895480 in Status: SUCCESS [ 848.790324] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.790455] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.790842] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.791096] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.791235] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.791297] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.791467] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.791582] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.791753] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.791753] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.977203] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaf974c-75cf-4b48-a666-f75dfe105a74 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.977428] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.977772] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbaf974c-75cf-4b48-a666-f75dfe105a74',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.981094] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 27626e1a-51fe-4f5a-9b93-8ab4c1b8b694 with status ACTIVE [ 848.981457] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.981974] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.981974] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.983521] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.983521] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.983521] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.983521] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.983521] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.983521] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.983821] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.984266] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.984266] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.984404] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.984617] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.984775] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.985458] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 27626e1a-51fe-4f5a-9b93-8ab4c1b8b694 is going to be updated. [ 849.018451] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.018451] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.018662] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.018807] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.018967] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.019174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27626e1a-51fe-4f5a-9b93-8ab4c1b8b694" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.295786] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a938b55d-b711-4079-9f7b-f27235895480 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.295953] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.296052] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.296283] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.296472] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.297066] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.297145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.297326] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.297411] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.297502] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.300211] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a938b55d-b711-4079-9f7b-f27235895480 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.300211] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.300211] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.300211] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.300211] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.300211] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.300211] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.300211] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.300211] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.300211] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.300211] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.306331] env[65783]: INFO networking_nsxv3.common.synchronization [None req-c114ed13-46d6-44a3-9403-d1f6e051dbb3 tempest-AttachVolumeTestJSON-999763968 tempest-AttachVolumeTestJSON-999763968-project-member] Enqueued Resource ID: 4a5d8777-50f6-4124-8014-838a921e8bd1 with Priority: HIGHEST for action security_group_rules [ 849.307116] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a5d8777-50f6-4124-8014-838a921e8bd1 with Priority: HIGHEST for action security_group_rules [ 849.307507] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a5d8777-50f6-4124-8014-838a921e8bd1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.307691] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a5d8777-50f6-4124-8014-838a921e8bd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.307805] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a5d8777-50f6-4124-8014-838a921e8bd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.308444] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a5d8777-50f6-4124-8014-838a921e8bd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.308444] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a5d8777-50f6-4124-8014-838a921e8bd1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.425558] env[65783]: INFO networking_nsxv3.common.synchronization [None req-3150a215-3291-4371-a405-f75197f961da tempest-AttachVolumeTestJSON-999763968 tempest-AttachVolumeTestJSON-999763968-project-member] Enqueued Resource ID: 4a5d8777-50f6-4124-8014-838a921e8bd1 with Priority: HIGHEST for action security_group_rules [ 849.426679] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a5d8777-50f6-4124-8014-838a921e8bd1 with Priority: HIGHEST for action security_group_rules [ 849.427405] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a5d8777-50f6-4124-8014-838a921e8bd1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.427405] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a5d8777-50f6-4124-8014-838a921e8bd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.482342] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbaf974c-75cf-4b48-a666-f75dfe105a74',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.802390] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a938b55d-b711-4079-9f7b-f27235895480: rpc.has_security_group_logging(os_id): False [ 849.826315] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.826511] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.826767] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.826848] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.826936] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.827162] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.827321] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.827407] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.827655] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.827744] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.828045] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.828370] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.828370] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.828535] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.828663] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.828866] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.828962] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.829064] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.829221] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.829276] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.829362] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a938b55d-b711-4079-9f7b-f27235895480 is going to be created. [ 849.835144] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.835144] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.835144] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.836243] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.836243] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.836243] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a5d8777-50f6-4124-8014-838a921e8bd1 already deleted. [ 849.836243] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a5d8777-50f6-4124-8014-838a921e8bd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.836243] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a5d8777-50f6-4124-8014-838a921e8bd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.836435] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a5d8777-50f6-4124-8014-838a921e8bd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.836471] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a5d8777-50f6-4124-8014-838a921e8bd1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.895973] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.895973] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.895973] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.895973] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.895973] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.915432] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a938b55d-b711-4079-9f7b-f27235895480 in Status: IN_PROGRESS for 2s [ 849.985963] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.986064] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.986173] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.987753] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.987753] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.987753] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbaf974c-75cf-4b48-a666-f75dfe105a74 is going to be created. [ 850.016080] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.016243] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.016243] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.016454] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.016634] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.036139] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaf974c-75cf-4b48-a666-f75dfe105a74 in Status: UNINITIALIZED for 2s [ 850.365832] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.366224] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.366366] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.366702] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.366812] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.366942] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a5d8777-50f6-4124-8014-838a921e8bd1 already deleted. [ 850.367061] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a5d8777-50f6-4124-8014-838a921e8bd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.564517] env[65783]: INFO networking_nsxv3.common.synchronization [None req-06b99bf3-0544-49c0-a585-19b7513190c6 None None] Enqueued Resource ID: 8d944147-fb76-4b32-96d2-2a792c068c2c with Priority: HIGHEST for action port [ 850.565161] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d944147-fb76-4b32-96d2-2a792c068c2c with Priority: HIGHEST for action port [ 850.565513] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d944147-fb76-4b32-96d2-2a792c068c2c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.565681] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d944147-fb76-4b32-96d2-2a792c068c2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.565781] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d944147-fb76-4b32-96d2-2a792c068c2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.566245] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d944147-fb76-4b32-96d2-2a792c068c2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.566334] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d944147-fb76-4b32-96d2-2a792c068c2c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.069494] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8d944147-fb76-4b32-96d2-2a792c068c2c [ 851.069936] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.070128] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.070209] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.070425] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.070513] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.070610] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8d944147-fb76-4b32-96d2-2a792c068c2c already deleted. [ 851.070689] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d944147-fb76-4b32-96d2-2a792c068c2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.928957] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a938b55d-b711-4079-9f7b-f27235895480 in Status: SUCCESS [ 851.928957] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.049111] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaf974c-75cf-4b48-a666-f75dfe105a74 in Status: SUCCESS [ 852.049383] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.049581] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.049840] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.050094] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.050233] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.050300] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.050455] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.050548] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.050635] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.050729] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbaf974c-75cf-4b48-a666-f75dfe105a74',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.085738] env[65783]: INFO networking_nsxv3.common.synchronization [req-9a2436e7-c7e7-4c55-9bae-a63c3039650a req-ad11e548-0856-4a8f-9245-d156115c3902 tempest-ServerActionsTestOtherB-29394606 tempest-ServerActionsTestOtherB-29394606-project-member] Enqueued Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_members [ 852.086432] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_members [ 852.087560] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c81f8cb-609b-4496-9f07-b80abbe519f8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.087698] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.087776] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.088020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.088208] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.088366] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.088476] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.088753] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.088851] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.088927] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.552750] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbaf974c-75cf-4b48-a666-f75dfe105a74',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.591604] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.591857] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.591857] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.592112] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.592200] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.592420] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.592518] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.592570] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.592745] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.592846] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.592950] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 is going to be updated. [ 852.632059] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.632321] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.632321] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.632537] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.632620] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.643654] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: IN_PROGRESS for 2s [ 853.056019] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbaf974c-75cf-4b48-a666-f75dfe105a74: rpc.has_security_group_logging(os_id): False [ 853.084483] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.084625] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.084716] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.084913] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.085007] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.085267] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.085361] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.085454] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.085649] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.085733] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.085824] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbaf974c-75cf-4b48-a666-f75dfe105a74 is going to be created. [ 853.204037] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.204348] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.204427] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.204790] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.205104] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.221299] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbaf974c-75cf-4b48-a666-f75dfe105a74 in Status: IN_PROGRESS for 2s [ 854.658723] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: SUCCESS [ 854.659080] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 deletion is rescheduled due to dependency. [ 854.659080] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.234291] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbaf974c-75cf-4b48-a666-f75dfe105a74 in Status: SUCCESS [ 855.234519] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.088205] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 857.088205] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 858.406844] env[65783]: INFO networking_nsxv3.common.synchronization [req-3297500f-fe7c-41b1-a58a-f0e7d5ff3ea7 req-8077ac49-e5a6-461a-bbeb-e64797791e80 tempest-AttachInterfacesUnderV243Test-2037762512 tempest-AttachInterfacesUnderV243Test-2037762512-project-member] Enqueued Resource ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 with Priority: HIGHEST for action security_group_members [ 858.407418] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 with Priority: HIGHEST for action security_group_members [ 858.407766] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.407906] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.408321] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.408471] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.409306] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.409306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.409306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.409306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.409306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.409306] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9af7ce2b-d35d-49a7-a534-d4ea3a2a2508',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.448428] env[65783]: INFO networking_nsxv3.common.synchronization [req-3297500f-fe7c-41b1-a58a-f0e7d5ff3ea7 req-8077ac49-e5a6-461a-bbeb-e64797791e80 tempest-AttachInterfacesUnderV243Test-2037762512 tempest-AttachInterfacesUnderV243Test-2037762512-project-member] Enqueued Resource ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 with Priority: HIGHEST for action security_group_rules [ 858.448428] env[65783]: INFO networking_nsxv3.common.synchronization [req-3297500f-fe7c-41b1-a58a-f0e7d5ff3ea7 req-8077ac49-e5a6-461a-bbeb-e64797791e80 tempest-AttachInterfacesUnderV243Test-2037762512 tempest-AttachInterfacesUnderV243Test-2037762512-project-member] Enqueued Resource ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 with Priority: HIGHEST for action security_group_members [ 858.448428] env[65783]: INFO networking_nsxv3.common.synchronization [req-3297500f-fe7c-41b1-a58a-f0e7d5ff3ea7 req-8077ac49-e5a6-461a-bbeb-e64797791e80 tempest-AttachInterfacesUnderV243Test-2037762512 tempest-AttachInterfacesUnderV243Test-2037762512-project-member] Enqueued Resource ID: a52878da-edb4-4e48-8028-2ef5a48d8253 with Priority: HIGHEST for action port [ 858.449674] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 with Priority: HIGHEST for action security_group_rules [ 858.449994] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 with Priority: HIGHEST for action security_group_members [ 858.450109] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a52878da-edb4-4e48-8028-2ef5a48d8253 with Priority: HIGHEST for action port [ 858.452717] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.453853] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.453853] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.453853] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.453853] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9af7ce2b-d35d-49a7-a534-d4ea3a2a2508',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.456029] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.456029] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.456316] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-a52878da-edb4-4e48-8028-2ef5a48d8253 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.456445] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a52878da-edb4-4e48-8028-2ef5a48d8253" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.456529] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a52878da-edb4-4e48-8028-2ef5a48d8253" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.456768] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a52878da-edb4-4e48-8028-2ef5a48d8253" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.456863] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a52878da-edb4-4e48-8028-2ef5a48d8253',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.914318] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9af7ce2b-d35d-49a7-a534-d4ea3a2a2508',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.961310] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.961310] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.961310] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a52878da-edb4-4e48-8028-2ef5a48d8253 with status ACTIVE [ 858.961310] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.961310] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.961310] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.961310] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.961310] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.961310] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.961310] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.961310] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.962128] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.962128] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.962128] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.962128] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.962128] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.962128] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.962626] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.962626] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a52878da-edb4-4e48-8028-2ef5a48d8253 is going to be updated. [ 858.985536] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.986323] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.986323] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.986552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.986686] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.986851] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a52878da-edb4-4e48-8028-2ef5a48d8253" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.417196] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9af7ce2b-d35d-49a7-a534-d4ea3a2a2508',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.921397] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.921715] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.921967] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.922233] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.922317] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.922433] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 is going to be updated. [ 859.952741] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.955696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.955696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.955696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.955696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.965382] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 in Status: IN_PROGRESS for 2s [ 860.718934] env[65783]: INFO networking_nsxv3.common.synchronization [req-c89596ee-9d08-444c-880c-ff9873231cfb req-e016c824-83e8-4f40-8194-5a021c83cfd4 tempest-ImagesOneServerNegativeTestJSON-1524253690 tempest-ImagesOneServerNegativeTestJSON-1524253690-project-member] Enqueued Resource ID: 6432899c-b0aa-4285-971f-16ac27b1305b with Priority: HIGHEST for action security_group_members [ 860.719978] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6432899c-b0aa-4285-971f-16ac27b1305b with Priority: HIGHEST for action security_group_members [ 860.720436] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-6432899c-b0aa-4285-971f-16ac27b1305b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.720614] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.720729] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.721033] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.721343] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.721538] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.721651] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.721943] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.722168] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.722321] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6432899c-b0aa-4285-971f-16ac27b1305b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.179163] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-169 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.179379] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-169" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.179839] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-169" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.179947] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-169" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.180632] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.180946] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.181168] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.181792] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.182045] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.182394] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 861.182588] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 861.182733] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 861.182874] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 861.183246] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 861.183339] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 861.183502] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 861.202580] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 861.202580] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 861.202580] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 861.202580] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-169" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.203077] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-48d24f13-8cff-4392-b381-04ec0ce66f8d taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.203077] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-48d24f13-8cff-4392-b381-04ec0ce66f8d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.203290] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-48d24f13-8cff-4392-b381-04ec0ce66f8d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.203545] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-48d24f13-8cff-4392-b381-04ec0ce66f8d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.203734] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48d24f13-8cff-4392-b381-04ec0ce66f8d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.224124] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.224124] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.224402] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.224449] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.224559] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.224771] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.224921] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.225045] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.225231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.225329] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.225432] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6432899c-b0aa-4285-971f-16ac27b1305b already deleted. [ 861.225533] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.706245] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.706245] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.706422] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.706602] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.707038] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.707038] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 48d24f13-8cff-4392-b381-04ec0ce66f8d not found, creating... [ 861.707157] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.707312] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.707445] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.707676] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.707820] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.708399] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.708399] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.708399] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.708909] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.708909] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.708909] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 48d24f13-8cff-4392-b381-04ec0ce66f8d is going to be created. [ 861.737045] env[65783]: INFO networking_nsxv3.common.synchronization [req-39c9f293-3eb1-48c5-91fd-7d9f011e1d5a req-dd33a877-1d36-443a-88a2-0d148cb4ad01 tempest-MigrationsAdminTest-1412758904 tempest-MigrationsAdminTest-1412758904-project-member] Enqueued Resource ID: b6e66254-5e43-437b-850b-825eaaa0cee1 with Priority: HIGHEST for action security_group_members [ 861.737655] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e66254-5e43-437b-850b-825eaaa0cee1 with Priority: HIGHEST for action security_group_members [ 861.738010] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e66254-5e43-437b-850b-825eaaa0cee1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.738418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.738418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.738589] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.738739] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.738836] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.738893] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.739035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.739120] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.739210] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6e66254-5e43-437b-850b-825eaaa0cee1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.748358] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.748576] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.748675] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.748934] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.749171] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.749464] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-48d24f13-8cff-4392-b381-04ec0ce66f8d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.975748] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 in Status: SUCCESS [ 861.975977] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.976162] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.976595] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.976595] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.976763] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.976763] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.976865] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.976949] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.977071] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9af7ce2b-d35d-49a7-a534-d4ea3a2a2508',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.211908] env[65783]: INFO networking_nsxv3.common.synchronization [req-283b34cc-2d39-4444-9c19-bb0326bd0b84 req-55011127-68db-453f-92be-8e27b30f3d5a tempest-AttachInterfacesUnderV243Test-2037762512 tempest-AttachInterfacesUnderV243Test-2037762512-project-member] Enqueued Resource ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 with Priority: HIGHEST for action security_group_members [ 862.213344] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 with Priority: HIGHEST for action security_group_members [ 862.213344] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.213344] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.227424] env[65783]: INFO networking_nsxv3.common.synchronization [req-283b34cc-2d39-4444-9c19-bb0326bd0b84 req-55011127-68db-453f-92be-8e27b30f3d5a tempest-AttachInterfacesUnderV243Test-2037762512 tempest-AttachInterfacesUnderV243Test-2037762512-project-member] Enqueued Resource ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 with Priority: HIGHEST for action security_group_rules [ 862.228612] env[65783]: INFO networking_nsxv3.common.synchronization [req-283b34cc-2d39-4444-9c19-bb0326bd0b84 req-55011127-68db-453f-92be-8e27b30f3d5a tempest-AttachInterfacesUnderV243Test-2037762512 tempest-AttachInterfacesUnderV243Test-2037762512-project-member] Enqueued Resource ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 with Priority: HIGHEST for action security_group_members [ 862.228612] env[65783]: INFO networking_nsxv3.common.synchronization [req-283b34cc-2d39-4444-9c19-bb0326bd0b84 req-55011127-68db-453f-92be-8e27b30f3d5a tempest-AttachInterfacesUnderV243Test-2037762512 tempest-AttachInterfacesUnderV243Test-2037762512-project-member] Enqueued Resource ID: a52878da-edb4-4e48-8028-2ef5a48d8253 with Priority: HIGHEST for action port [ 862.228837] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 with Priority: HIGHEST for action security_group_rules [ 862.228837] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 with Priority: HIGHEST for action security_group_members [ 862.228921] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a52878da-edb4-4e48-8028-2ef5a48d8253 with Priority: HIGHEST for action port [ 862.229239] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.229239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.229413] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.229524] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.229681] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-a52878da-edb4-4e48-8028-2ef5a48d8253 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.229787] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a52878da-edb4-4e48-8028-2ef5a48d8253" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.229827] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a52878da-edb4-4e48-8028-2ef5a48d8253" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.230033] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a52878da-edb4-4e48-8028-2ef5a48d8253" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.230139] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a52878da-edb4-4e48-8028-2ef5a48d8253',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.242042] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b6e66254-5e43-437b-850b-825eaaa0cee1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.480288] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9af7ce2b-d35d-49a7-a534-d4ea3a2a2508',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.547769] env[65783]: INFO networking_nsxv3.common.synchronization [req-c89596ee-9d08-444c-880c-ff9873231cfb req-962a5b73-9ae7-433f-b258-6b512619b61b service nova] Enqueued Resource ID: 6432899c-b0aa-4285-971f-16ac27b1305b with Priority: HIGHEST for action security_group_rules [ 862.547769] env[65783]: INFO networking_nsxv3.common.synchronization [req-c89596ee-9d08-444c-880c-ff9873231cfb req-962a5b73-9ae7-433f-b258-6b512619b61b service nova] Enqueued Resource ID: 6432899c-b0aa-4285-971f-16ac27b1305b with Priority: HIGHEST for action security_group_members [ 862.547769] env[65783]: INFO networking_nsxv3.common.synchronization [req-c89596ee-9d08-444c-880c-ff9873231cfb req-962a5b73-9ae7-433f-b258-6b512619b61b service nova] Enqueued Resource ID: 48d24f13-8cff-4392-b381-04ec0ce66f8d with Priority: HIGHEST for action port [ 862.547769] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6432899c-b0aa-4285-971f-16ac27b1305b with Priority: HIGHEST for action security_group_rules [ 862.547769] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6432899c-b0aa-4285-971f-16ac27b1305b with Priority: HIGHEST for action security_group_members [ 862.547769] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d24f13-8cff-4392-b381-04ec0ce66f8d with Priority: HIGHEST for action port [ 862.547769] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6432899c-b0aa-4285-971f-16ac27b1305b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.547769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.547769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.547769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.547769] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6432899c-b0aa-4285-971f-16ac27b1305b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.547769] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-6432899c-b0aa-4285-971f-16ac27b1305b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.547769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.547769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.547769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.547769] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.547769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.547769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.547769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.547769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.550246] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6432899c-b0aa-4285-971f-16ac27b1305b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.550246] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-48d24f13-8cff-4392-b381-04ec0ce66f8d taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.550246] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48d24f13-8cff-4392-b381-04ec0ce66f8d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.550246] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48d24f13-8cff-4392-b381-04ec0ce66f8d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.550246] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48d24f13-8cff-4392-b381-04ec0ce66f8d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.550246] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48d24f13-8cff-4392-b381-04ec0ce66f8d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.732350] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a52878da-edb4-4e48-8028-2ef5a48d8253 with status ACTIVE [ 862.732409] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.733046] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.733046] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.733046] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.733046] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.733046] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.733273] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.733273] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.733335] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.733405] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.733584] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.733657] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.733714] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.733846] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.733915] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.733993] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a52878da-edb4-4e48-8028-2ef5a48d8253 is going to be updated. [ 862.746174] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b6e66254-5e43-437b-850b-825eaaa0cee1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.756135] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.756135] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.756135] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.756135] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.756135] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.756135] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a52878da-edb4-4e48-8028-2ef5a48d8253" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.983291] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9af7ce2b-d35d-49a7-a534-d4ea3a2a2508',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.014850] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6432899c-b0aa-4285-971f-16ac27b1305b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.016038] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-6432899c-b0aa-4285-971f-16ac27b1305b taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.016172] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.016692] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48d24f13-8cff-4392-b381-04ec0ce66f8d with status ACTIVE [ 863.016763] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.016861] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.017018] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.017208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.017349] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.017542] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.017650] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.017714] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.018075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.018176] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.018372] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.018473] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.018537] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.018910] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.018910] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.018910] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48d24f13-8cff-4392-b381-04ec0ce66f8d is going to be updated. [ 863.040671] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.040838] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.040884] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.041100] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.041235] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.041414] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48d24f13-8cff-4392-b381-04ec0ce66f8d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.251581] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.251765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.251765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.253167] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.253167] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.253167] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6e66254-5e43-437b-850b-825eaaa0cee1 is going to be updated. [ 863.282737] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.282899] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.282997] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.283230] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.283371] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.293548] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6e66254-5e43-437b-850b-825eaaa0cee1 in Status: IN_PROGRESS for 2s [ 863.485799] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.485961] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.486053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.486277] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.486414] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.486452] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 is going to be updated. [ 863.517382] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6432899c-b0aa-4285-971f-16ac27b1305b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.538499] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.538649] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.538720] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.538936] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.539095] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.552579] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 in Status: IN_PROGRESS for 2s [ 864.020079] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.020363] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.020363] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.020785] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.021100] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.021206] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6432899c-b0aa-4285-971f-16ac27b1305b is going to be created. [ 864.048701] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.048701] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.049293] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.049414] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.049667] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.068780] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6432899c-b0aa-4285-971f-16ac27b1305b in Status: UNINITIALIZED for 2s [ 864.407151] env[65783]: INFO networking_nsxv3.common.synchronization [req-9edba7f0-911a-4e87-9e65-2e55270b64a2 req-a77e94c0-cb3e-4004-bce6-f6e13aa32e20 tempest-ServerAddressesTestJSON-2021451561 tempest-ServerAddressesTestJSON-2021451561-project-member] Enqueued Resource ID: 044a26f5-b666-44c4-8c58-085d6cf0af26 with Priority: HIGHEST for action security_group_members [ 864.408082] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 044a26f5-b666-44c4-8c58-085d6cf0af26 with Priority: HIGHEST for action security_group_members [ 864.408795] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-044a26f5-b666-44c4-8c58-085d6cf0af26 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.408795] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-044a26f5-b666-44c4-8c58-085d6cf0af26" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.408795] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-044a26f5-b666-44c4-8c58-085d6cf0af26" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.408998] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-044a26f5-b666-44c4-8c58-085d6cf0af26" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.409144] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.409276] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.409355] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.409545] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.409654] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.409956] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('044a26f5-b666-44c4-8c58-085d6cf0af26',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.912487] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.915020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.915020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.915020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.915020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.915020] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.915020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.915020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.915020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.915020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.915020] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 044a26f5-b666-44c4-8c58-085d6cf0af26 already deleted. [ 864.915020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-044a26f5-b666-44c4-8c58-085d6cf0af26" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.930142] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.930325] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-731" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.932238] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-731" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.932238] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-731" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.932628] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.932708] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.932834] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.933144] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.933288] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.933532] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 864.933667] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 864.933791] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 864.933924] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 864.934041] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 864.934162] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 864.934336] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 864.938814] env[65783]: INFO networking_nsxv3.common.synchronization [None req-e4cd0df3-da7e-4543-8560-377b9ebc9da4 None None] Enqueued Resource ID: c84567ca-87f2-4a76-aff2-d64024b0f605 with Priority: HIGHEST for action port [ 864.939492] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c84567ca-87f2-4a76-aff2-d64024b0f605 with Priority: HIGHEST for action port [ 864.940398] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-c84567ca-87f2-4a76-aff2-d64024b0f605 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.940545] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c84567ca-87f2-4a76-aff2-d64024b0f605" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.940545] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c84567ca-87f2-4a76-aff2-d64024b0f605" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.941151] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c84567ca-87f2-4a76-aff2-d64024b0f605" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.941151] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c84567ca-87f2-4a76-aff2-d64024b0f605',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.957400] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 864.957400] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 864.957563] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 864.957999] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-731" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.958393] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-6fe0678d-9d42-48ef-ace8-37c30ef0cc23 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.959686] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-6fe0678d-9d42-48ef-ace8-37c30ef0cc23" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.959686] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-6fe0678d-9d42-48ef-ace8-37c30ef0cc23" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.959686] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-6fe0678d-9d42-48ef-ace8-37c30ef0cc23" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.959974] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fe0678d-9d42-48ef-ace8-37c30ef0cc23',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.308163] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6e66254-5e43-437b-850b-825eaaa0cee1 in Status: SUCCESS [ 865.308415] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.448761] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c84567ca-87f2-4a76-aff2-d64024b0f605 [ 865.448998] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.449144] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.449202] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.449416] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.449505] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.449598] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c84567ca-87f2-4a76-aff2-d64024b0f605 already deleted. [ 865.449677] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c84567ca-87f2-4a76-aff2-d64024b0f605" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.463304] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.463492] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.463616] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.463889] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.464044] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.464213] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 6fe0678d-9d42-48ef-ace8-37c30ef0cc23 not found, creating... [ 865.464464] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.464625] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.464742] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.464959] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.465109] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.465390] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.465542] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.465672] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.465852] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.465982] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.466139] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 6fe0678d-9d42-48ef-ace8-37c30ef0cc23 is going to be created. [ 865.488193] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.488446] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.488598] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.488873] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.489135] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.489545] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-6fe0678d-9d42-48ef-ace8-37c30ef0cc23" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.568528] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 in Status: SUCCESS [ 865.568813] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.569030] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.569287] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.569514] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.569666] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.569753] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.570058] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.570149] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.570237] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.570337] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9af7ce2b-d35d-49a7-a534-d4ea3a2a2508',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.571280] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.571473] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.571666] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.571799] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.571935] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.572141] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.572244] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.572360] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9af7ce2b-d35d-49a7-a534-d4ea3a2a2508',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.074626] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9af7ce2b-d35d-49a7-a534-d4ea3a2a2508',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.076626] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9af7ce2b-d35d-49a7-a534-d4ea3a2a2508',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.077566] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6432899c-b0aa-4285-971f-16ac27b1305b in Status: SUCCESS [ 866.077778] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.077904] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.078437] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.078753] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.078753] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.078945] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.079010] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.079116] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.079281] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.079372] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6432899c-b0aa-4285-971f-16ac27b1305b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.202786] env[65783]: INFO networking_nsxv3.common.synchronization [req-9edba7f0-911a-4e87-9e65-2e55270b64a2 req-37e0be57-ad81-4da4-9157-d77653c7517b service nova] Enqueued Resource ID: 044a26f5-b666-44c4-8c58-085d6cf0af26 with Priority: HIGHEST for action security_group_rules [ 866.203025] env[65783]: INFO networking_nsxv3.common.synchronization [req-9edba7f0-911a-4e87-9e65-2e55270b64a2 req-37e0be57-ad81-4da4-9157-d77653c7517b service nova] Enqueued Resource ID: 044a26f5-b666-44c4-8c58-085d6cf0af26 with Priority: HIGHEST for action security_group_members [ 866.203215] env[65783]: INFO networking_nsxv3.common.synchronization [req-9edba7f0-911a-4e87-9e65-2e55270b64a2 req-37e0be57-ad81-4da4-9157-d77653c7517b service nova] Enqueued Resource ID: 6fe0678d-9d42-48ef-ace8-37c30ef0cc23 with Priority: HIGHEST for action port [ 866.203728] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 044a26f5-b666-44c4-8c58-085d6cf0af26 with Priority: HIGHEST for action security_group_rules [ 866.203991] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 044a26f5-b666-44c4-8c58-085d6cf0af26 with Priority: HIGHEST for action security_group_members [ 866.203991] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe0678d-9d42-48ef-ace8-37c30ef0cc23 with Priority: HIGHEST for action port [ 866.204500] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-044a26f5-b666-44c4-8c58-085d6cf0af26 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.204669] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-044a26f5-b666-44c4-8c58-085d6cf0af26" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.204742] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-044a26f5-b666-44c4-8c58-085d6cf0af26" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.205028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-044a26f5-b666-44c4-8c58-085d6cf0af26" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.205146] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('044a26f5-b666-44c4-8c58-085d6cf0af26',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.206210] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-044a26f5-b666-44c4-8c58-085d6cf0af26 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.206266] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-044a26f5-b666-44c4-8c58-085d6cf0af26" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.206371] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-044a26f5-b666-44c4-8c58-085d6cf0af26" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.206691] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-044a26f5-b666-44c4-8c58-085d6cf0af26" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.206872] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.207959] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.207959] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.207959] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.207959] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.207959] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('044a26f5-b666-44c4-8c58-085d6cf0af26',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.208549] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fe0678d-9d42-48ef-ace8-37c30ef0cc23 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.208549] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fe0678d-9d42-48ef-ace8-37c30ef0cc23" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.208656] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fe0678d-9d42-48ef-ace8-37c30ef0cc23" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.208897] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fe0678d-9d42-48ef-ace8-37c30ef0cc23" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.208897] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fe0678d-9d42-48ef-ace8-37c30ef0cc23',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.577212] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508: rpc.has_security_group_logging(os_id): False [ 866.581323] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-6432899c-b0aa-4285-971f-16ac27b1305b taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.581483] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.581557] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.581853] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.582085] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.582085] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.582252] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.582297] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.582436] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.582850] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.582850] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-6432899c-b0aa-4285-971f-16ac27b1305b taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.582850] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.582850] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.583343] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.583343] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.583343] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.583343] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.583518] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.583518] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.583677] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.583721] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6432899c-b0aa-4285-971f-16ac27b1305b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.587200] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9af7ce2b-d35d-49a7-a534-d4ea3a2a2508',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.602777] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.602962] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.603021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.603220] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.635678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.635993] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.636142] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.636203] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.636399] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.636482] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.636561] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 is going to be updated. [ 866.712568] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6fe0678d-9d42-48ef-ace8-37c30ef0cc23 with status ACTIVE [ 866.712568] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.712762] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.712762] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.713064] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.713064] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.713347] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.713347] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.713555] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.713584] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.713674] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.713888] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.713990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.714059] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.714249] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.714324] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.714426] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6fe0678d-9d42-48ef-ace8-37c30ef0cc23 is going to be updated. [ 866.717337] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-044a26f5-b666-44c4-8c58-085d6cf0af26 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.717337] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-044a26f5-b666-44c4-8c58-085d6cf0af26" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.717337] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('044a26f5-b666-44c4-8c58-085d6cf0af26',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.763257] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.763418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.763513] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.763701] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.763858] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.764013] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fe0678d-9d42-48ef-ace8-37c30ef0cc23" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.767194] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.767342] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.767425] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.767592] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.767725] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.785452] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 in Status: IN_PROGRESS for 2s [ 867.089542] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.089542] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.089542] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.089542] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.089542] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.090148] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 is going to be updated. [ 867.092925] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6432899c-b0aa-4285-971f-16ac27b1305b: rpc.has_security_group_logging(os_id): False [ 867.117084] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.117337] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.117411] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.117626] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.117710] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.117911] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.118026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.118105] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.118266] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.118337] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.118536] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.118622] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.118679] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.118812] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.118878] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.119361] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.119619] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.121558] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.121558] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.121558] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.121558] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6432899c-b0aa-4285-971f-16ac27b1305b is going to be created. [ 867.132532] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.132711] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.132806] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.132979] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.133331] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.147613] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 in Status: IN_PROGRESS for 2s [ 867.162525] env[65783]: INFO networking_nsxv3.common.synchronization [None req-04d59c8d-f4c5-44ec-b3ce-c13004c174cb None None] Enqueued Resource ID: 02601ba8-ce51-49c0-a5d9-beed19998042 with Priority: HIGHEST for action port [ 867.163169] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02601ba8-ce51-49c0-a5d9-beed19998042 with Priority: HIGHEST for action port [ 867.163566] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-02601ba8-ce51-49c0-a5d9-beed19998042 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.163703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02601ba8-ce51-49c0-a5d9-beed19998042" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.164013] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02601ba8-ce51-49c0-a5d9-beed19998042" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.164013] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02601ba8-ce51-49c0-a5d9-beed19998042" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.165160] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02601ba8-ce51-49c0-a5d9-beed19998042',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.193098] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.193300] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.193300] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.193469] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.193646] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.209457] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6432899c-b0aa-4285-971f-16ac27b1305b in Status: IN_PROGRESS for 2s [ 867.219540] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('044a26f5-b666-44c4-8c58-085d6cf0af26',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.257518] env[65783]: INFO networking_nsxv3.common.synchronization [req-1af51c8f-4912-4ab3-a1d5-62d0829f4f1f req-5081a889-8db0-4e60-91d9-032041d79df7 tempest-ListServerFiltersTestJSON-326822078 tempest-ListServerFiltersTestJSON-326822078-project-member] Enqueued Resource ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 with Priority: HIGHEST for action security_group_members [ 867.258428] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 with Priority: HIGHEST for action security_group_members [ 867.259083] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-74220b44-588c-49ac-81cc-e6ac2b7c6024 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.259446] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.259657] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.260169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.260520] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.260763] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.260898] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.261154] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.261318] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.261482] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.424510] env[65783]: INFO networking_nsxv3.common.synchronization [req-1efe6a82-57f3-467b-bfca-c92812c1d2e6 req-cb1cb50d-f36a-46c6-86ab-8d0cb22b8531 tempest-AttachInterfacesUnderV243Test-2037762512 tempest-AttachInterfacesUnderV243Test-2037762512-project-member] Enqueued Resource ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 with Priority: HIGHEST for action security_group_members [ 867.424895] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 with Priority: HIGHEST for action security_group_members [ 867.427039] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.427039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.669482] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 02601ba8-ce51-49c0-a5d9-beed19998042 [ 867.669732] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.669862] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.669935] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.670176] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.670281] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.670379] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:02601ba8-ce51-49c0-a5d9-beed19998042 already deleted. [ 867.670458] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02601ba8-ce51-49c0-a5d9-beed19998042" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.721804] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.721963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.722044] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.722263] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.722349] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.722445] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 044a26f5-b666-44c4-8c58-085d6cf0af26 is going to be created. [ 867.756833] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.757761] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.757761] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.757761] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.757761] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.759468] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-891 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.761326] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-891" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.761326] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-891" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.761326] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-891" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.761326] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.761499] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.761593] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.761808] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.763916] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.763916] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 867.764089] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 867.764116] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 867.764275] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 867.764402] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 867.764506] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 867.764632] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 867.766221] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.766337] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.766401] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.766566] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.766647] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.766823] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.766918] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.766979] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.767133] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.767207] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.767289] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 already deleted. [ 867.767462] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.783046] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 044a26f5-b666-44c4-8c58-085d6cf0af26 in Status: UNINITIALIZED for 2s [ 867.788258] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 867.788328] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 867.788738] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 867.788955] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-891" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.789368] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-3a1140bb-e791-40d3-a08e-d01e1bfb79b6 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.789737] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-3a1140bb-e791-40d3-a08e-d01e1bfb79b6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.789828] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-3a1140bb-e791-40d3-a08e-d01e1bfb79b6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.790233] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-3a1140bb-e791-40d3-a08e-d01e1bfb79b6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.790455] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a1140bb-e791-40d3-a08e-d01e1bfb79b6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.293786] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.294018] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.294387] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.294459] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.294561] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.294711] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 3a1140bb-e791-40d3-a08e-d01e1bfb79b6 not found, creating... [ 868.294969] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.295148] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.295268] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.295503] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.295639] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.295919] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.296132] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.296273] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.296487] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.296617] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.297109] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 3a1140bb-e791-40d3-a08e-d01e1bfb79b6 is going to be created. [ 868.324348] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.324348] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.324348] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.324348] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.324348] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.324348] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-3a1140bb-e791-40d3-a08e-d01e1bfb79b6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.801035] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 in Status: SUCCESS [ 868.801408] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.801408] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.802049] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.802049] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9af7ce2b-d35d-49a7-a534-d4ea3a2a2508',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.962603] env[65783]: INFO networking_nsxv3.common.synchronization [req-6bf9dc81-8f6c-48bd-ae08-c01a2545d905 req-0a5f7840-9550-45a9-b5c9-5eec254fd00d tempest-ServersWithSpecificFlavorTestJSON-767212478 tempest-ServersWithSpecificFlavorTestJSON-767212478-project-member] Enqueued Resource ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 with Priority: HIGHEST for action security_group_members [ 868.963516] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 with Priority: HIGHEST for action security_group_members [ 868.963810] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e588ff7c-d45a-4b75-823e-f219eeb5e814 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.964019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.964136] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.964424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.964660] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.964836] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.964935] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.965191] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.965334] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.965479] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e588ff7c-d45a-4b75-823e-f219eeb5e814',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.066336] env[65783]: INFO networking_nsxv3.common.synchronization [req-1af51c8f-4912-4ab3-a1d5-62d0829f4f1f req-93a89e46-9079-4f33-845f-61ad678a06f7 service nova] Enqueued Resource ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 with Priority: HIGHEST for action security_group_rules [ 869.066518] env[65783]: INFO networking_nsxv3.common.synchronization [req-1af51c8f-4912-4ab3-a1d5-62d0829f4f1f req-93a89e46-9079-4f33-845f-61ad678a06f7 service nova] Enqueued Resource ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 with Priority: HIGHEST for action security_group_members [ 869.066656] env[65783]: INFO networking_nsxv3.common.synchronization [req-1af51c8f-4912-4ab3-a1d5-62d0829f4f1f req-93a89e46-9079-4f33-845f-61ad678a06f7 service nova] Enqueued Resource ID: 3a1140bb-e791-40d3-a08e-d01e1bfb79b6 with Priority: HIGHEST for action port [ 869.066881] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 with Priority: HIGHEST for action security_group_rules [ 869.067017] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 with Priority: HIGHEST for action security_group_members [ 869.067117] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a1140bb-e791-40d3-a08e-d01e1bfb79b6 with Priority: HIGHEST for action port [ 869.067652] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74220b44-588c-49ac-81cc-e6ac2b7c6024 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.067774] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.067840] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.068113] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.068197] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.069325] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-74220b44-588c-49ac-81cc-e6ac2b7c6024 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.069437] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.069437] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.070126] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.070126] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.070126] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.070126] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.070126] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.070126] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.070298] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.070908] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a1140bb-e791-40d3-a08e-d01e1bfb79b6 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.071022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a1140bb-e791-40d3-a08e-d01e1bfb79b6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.071096] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a1140bb-e791-40d3-a08e-d01e1bfb79b6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.071261] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a1140bb-e791-40d3-a08e-d01e1bfb79b6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.071366] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a1140bb-e791-40d3-a08e-d01e1bfb79b6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.165040] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 in Status: SUCCESS [ 869.165040] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.165040] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.165040] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.165040] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.165040] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.165040] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.165040] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.165040] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.165776] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9af7ce2b-d35d-49a7-a534-d4ea3a2a2508',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.222513] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6432899c-b0aa-4285-971f-16ac27b1305b in Status: SUCCESS [ 869.223086] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.322928] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.323126] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.323172] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.323358] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.323446] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.323540] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 is going to be deleted. [ 869.378384] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.378625] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.378732] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.379061] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.379225] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.380531] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.467756] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.467940] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.467995] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.468220] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.468315] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.468509] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.468604] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.468663] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.468806] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.468880] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.468971] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 is going to be updated. [ 869.508048] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.508187] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.509027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.509027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.509027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.523351] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 in Status: IN_PROGRESS for 2s [ 869.573124] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.574429] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-74220b44-588c-49ac-81cc-e6ac2b7c6024 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.574429] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.574607] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a1140bb-e791-40d3-a08e-d01e1bfb79b6 with status ACTIVE [ 869.574775] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.574862] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.574862] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.575079] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.575177] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.575804] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.575804] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.575804] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.575804] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.575804] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.576051] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.576051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.576148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.576471] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.576577] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.576667] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a1140bb-e791-40d3-a08e-d01e1bfb79b6 is going to be updated. [ 869.606419] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.606598] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.606648] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.607470] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.607470] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.607470] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a1140bb-e791-40d3-a08e-d01e1bfb79b6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.671153] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.671348] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.671466] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.671630] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.671721] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.672752] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.672882] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.672960] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.673211] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.673306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.673460] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 is going to be deleted. [ 869.713124] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.713288] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.713388] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.713656] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.713769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.713889] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.714112] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.714279] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.714460] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.714586] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.714684] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.714851] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.714953] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.715085] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9af7ce2b-d35d-49a7-a534-d4ea3a2a2508',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.794621] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 044a26f5-b666-44c4-8c58-085d6cf0af26 in Status: SUCCESS [ 869.796519] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-044a26f5-b666-44c4-8c58-085d6cf0af26" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.796519] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-044a26f5-b666-44c4-8c58-085d6cf0af26" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.796519] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-044a26f5-b666-44c4-8c58-085d6cf0af26" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.796519] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.796755] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.796755] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.796983] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.797150] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.797304] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-044a26f5-b666-44c4-8c58-085d6cf0af26" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.797470] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('044a26f5-b666-44c4-8c58-085d6cf0af26',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.977837] env[65783]: INFO networking_nsxv3.common.synchronization [req-c5c68fdd-8e03-4814-ae56-04784b735f77 req-3c062bfd-7f95-4550-b554-016fa6e71adb tempest-ListServerFiltersTestJSON-326822078 tempest-ListServerFiltersTestJSON-326822078-project-member] Enqueued Resource ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 with Priority: HIGHEST for action security_group_members [ 869.977837] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 with Priority: HIGHEST for action security_group_members [ 869.978148] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-74220b44-588c-49ac-81cc-e6ac2b7c6024 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.978248] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.078952] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.092792] env[65783]: INFO networking_nsxv3.common.synchronization [req-6ecd9046-2d96-41e7-afaf-a7dd0fe25272 req-61774f54-9eef-4570-82e4-e96a67f3911c tempest-ListImageFiltersTestJSON-600591362 tempest-ListImageFiltersTestJSON-600591362-project-member] Enqueued Resource ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 with Priority: HIGHEST for action security_group_members [ 870.093512] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 with Priority: HIGHEST for action security_group_members [ 870.093858] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-177e22b5-9104-44ad-8e54-e2d4da7915c9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.093981] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.095451] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.096274] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.096459] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.096578] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.096641] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.096807] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.096891] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.096985] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('177e22b5-9104-44ad-8e54-e2d4da7915c9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.218871] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.218871] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.218871] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.218871] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.218871] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.218871] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.218871] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.218871] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.218871] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.218871] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.218871] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9af7ce2b-d35d-49a7-a534-d4ea3a2a2508 already deleted. [ 870.218871] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9af7ce2b-d35d-49a7-a534-d4ea3a2a2508" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.304070] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-044a26f5-b666-44c4-8c58-085d6cf0af26 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.304070] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-044a26f5-b666-44c4-8c58-085d6cf0af26" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.304070] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-044a26f5-b666-44c4-8c58-085d6cf0af26" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.304070] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-044a26f5-b666-44c4-8c58-085d6cf0af26" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.304070] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.304070] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.304070] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.304070] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.304070] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.304070] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-044a26f5-b666-44c4-8c58-085d6cf0af26" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.304070] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-044a26f5-b666-44c4-8c58-085d6cf0af26 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.304070] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-044a26f5-b666-44c4-8c58-085d6cf0af26" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.304070] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-044a26f5-b666-44c4-8c58-085d6cf0af26" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.304070] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-044a26f5-b666-44c4-8c58-085d6cf0af26" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.304070] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.304070] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.305068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.305068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.305068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.305068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-044a26f5-b666-44c4-8c58-085d6cf0af26" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.305068] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('044a26f5-b666-44c4-8c58-085d6cf0af26',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.328089] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-891 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.328294] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-891" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.328416] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-891" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.328680] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-891" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.329572] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.329572] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.329572] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.329773] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.329962] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.330241] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 870.330395] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 870.330939] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 870.330939] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 870.330939] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 870.330939] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 870.331230] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 870.358466] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 870.358793] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 870.359029] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 870.359317] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-891" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.359732] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-02faaa1a-1e5f-46a3-ba39-2e846e4ce4aa taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.359967] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-02faaa1a-1e5f-46a3-ba39-2e846e4ce4aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.360241] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-02faaa1a-1e5f-46a3-ba39-2e846e4ce4aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.360609] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-02faaa1a-1e5f-46a3-ba39-2e846e4ce4aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.360798] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02faaa1a-1e5f-46a3-ba39-2e846e4ce4aa',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.584143] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.584143] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.584338] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.584504] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.584627] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.584735] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 is going to be created. [ 870.601262] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('177e22b5-9104-44ad-8e54-e2d4da7915c9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.610971] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.610971] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.610971] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.610971] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.610971] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.622274] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 in Status: UNINITIALIZED for 2s [ 870.810152] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 044a26f5-b666-44c4-8c58-085d6cf0af26: rpc.has_security_group_logging(os_id): False [ 870.828768] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.828918] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.828985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.829247] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.829809] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.829809] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.829809] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.829809] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.829809] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.830419] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.830419] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.830419] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.830419] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.830419] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.830659] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.830763] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.830825] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.830870] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.831019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.831108] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.831192] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 044a26f5-b666-44c4-8c58-085d6cf0af26 is going to be created. [ 870.864141] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.865151] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.865151] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.865151] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.865534] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.865534] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 02faaa1a-1e5f-46a3-ba39-2e846e4ce4aa not found, creating... [ 870.865616] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.865780] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.865901] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.866173] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.866310] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.866669] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.866865] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.867054] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.867291] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.867440] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.867580] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 02faaa1a-1e5f-46a3-ba39-2e846e4ce4aa is going to be created. [ 870.890632] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.890836] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.891034] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.891369] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.892332] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.892606] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-02faaa1a-1e5f-46a3-ba39-2e846e4ce4aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.902750] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.902750] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.903344] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.903344] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.903344] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.914530] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 044a26f5-b666-44c4-8c58-085d6cf0af26 in Status: IN_PROGRESS for 2s [ 871.104504] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('177e22b5-9104-44ad-8e54-e2d4da7915c9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.534044] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 in Status: SUCCESS [ 871.534306] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 deletion is rescheduled due to dependency. [ 871.534495] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.608033] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.608033] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.608033] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.608033] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.608033] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.608311] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 is going to be updated. [ 871.622599] env[65783]: INFO networking_nsxv3.common.synchronization [req-c5c68fdd-8e03-4814-ae56-04784b735f77 req-43bf11fc-16ba-4278-994c-c05540fdf456 service nova] Enqueued Resource ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 with Priority: HIGHEST for action security_group_rules [ 871.622776] env[65783]: INFO networking_nsxv3.common.synchronization [req-c5c68fdd-8e03-4814-ae56-04784b735f77 req-43bf11fc-16ba-4278-994c-c05540fdf456 service nova] Enqueued Resource ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 with Priority: HIGHEST for action security_group_members [ 871.623078] env[65783]: INFO networking_nsxv3.common.synchronization [req-c5c68fdd-8e03-4814-ae56-04784b735f77 req-43bf11fc-16ba-4278-994c-c05540fdf456 service nova] Enqueued Resource ID: 02faaa1a-1e5f-46a3-ba39-2e846e4ce4aa with Priority: HIGHEST for action port [ 871.623541] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 with Priority: HIGHEST for action security_group_rules [ 871.623683] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 with Priority: HIGHEST for action security_group_members [ 871.623777] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02faaa1a-1e5f-46a3-ba39-2e846e4ce4aa with Priority: HIGHEST for action port [ 871.624233] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74220b44-588c-49ac-81cc-e6ac2b7c6024 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.624396] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.624600] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-74220b44-588c-49ac-81cc-e6ac2b7c6024 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.624680] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.625250] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-02faaa1a-1e5f-46a3-ba39-2e846e4ce4aa taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.625360] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02faaa1a-1e5f-46a3-ba39-2e846e4ce4aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.625434] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02faaa1a-1e5f-46a3-ba39-2e846e4ce4aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.625703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02faaa1a-1e5f-46a3-ba39-2e846e4ce4aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.625703] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02faaa1a-1e5f-46a3-ba39-2e846e4ce4aa',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.645461] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.645461] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.645582] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.645715] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.645856] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.656483] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 in Status: IN_PROGRESS for 2s [ 872.128201] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 02faaa1a-1e5f-46a3-ba39-2e846e4ce4aa with status ACTIVE [ 872.128513] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.128592] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.128803] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.129087] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.129182] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.129398] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.129485] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.129547] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.129698] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.129845] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.130075] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.130174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.130236] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.130381] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.130455] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.130531] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 02faaa1a-1e5f-46a3-ba39-2e846e4ce4aa is going to be updated. [ 872.152011] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.152126] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.152226] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.152718] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.153025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.153241] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02faaa1a-1e5f-46a3-ba39-2e846e4ce4aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.625398] env[65783]: INFO networking_nsxv3.common.synchronization [req-1576d4c5-554d-4adf-9d99-e0d80407c984 req-e921688f-60d2-44dc-be7f-9f709b152346 tempest-ListServerFiltersTestJSON-326822078 tempest-ListServerFiltersTestJSON-326822078-project-member] Enqueued Resource ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 with Priority: HIGHEST for action security_group_members [ 872.626191] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 with Priority: HIGHEST for action security_group_members [ 872.626652] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-74220b44-588c-49ac-81cc-e6ac2b7c6024 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.626817] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.634998] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 in Status: SUCCESS [ 872.634998] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.634998] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.635191] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.635805] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.635805] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.635805] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.635805] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.635805] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.635805] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.636106] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.636778] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.636943] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.637113] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.637537] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.637537] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.637537] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.637537] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.637537] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.927779] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 044a26f5-b666-44c4-8c58-085d6cf0af26 in Status: SUCCESS [ 872.928387] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-044a26f5-b666-44c4-8c58-085d6cf0af26" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.093369] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-891 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.093570] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-891" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.093693] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-891" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.093961] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-891" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.094246] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.094401] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.094513] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.094720] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.094854] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.095099] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 873.095212] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 873.095319] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 873.095422] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 873.095526] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 873.095626] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 873.095750] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 873.131759] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 873.131759] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 873.132166] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 873.132166] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-891" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.132601] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-680d08e3-6217-4e78-82fa-ea979448f95c taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.132720] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-680d08e3-6217-4e78-82fa-ea979448f95c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.133664] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-680d08e3-6217-4e78-82fa-ea979448f95c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.133664] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-680d08e3-6217-4e78-82fa-ea979448f95c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.133664] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('680d08e3-6217-4e78-82fa-ea979448f95c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.140183] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.141441] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-74220b44-588c-49ac-81cc-e6ac2b7c6024 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.141610] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.636364] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.636538] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.636693] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.637502] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.637793] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.638491] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 680d08e3-6217-4e78-82fa-ea979448f95c not found, creating... [ 873.638569] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.638974] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.639217] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.639648] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.640085] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.640731] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.640978] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.641087] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.641360] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.641586] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.641994] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 680d08e3-6217-4e78-82fa-ea979448f95c is going to be created. [ 873.643086] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.669614] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.670179] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.670368] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.671281] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.671544] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.671820] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-680d08e3-6217-4e78-82fa-ea979448f95c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.673856] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 in Status: SUCCESS [ 873.674100] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.146139] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.146433] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.146433] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.146586] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.146674] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.146937] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 is going to be updated. [ 874.184227] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.184573] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.184573] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.184718] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.184776] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.196016] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 in Status: IN_PROGRESS for 2s [ 874.371569] env[65783]: INFO networking_nsxv3.common.synchronization [req-1576d4c5-554d-4adf-9d99-e0d80407c984 req-8bfa12a8-77e8-45fd-93b7-6f5cd2af65d7 service nova] Enqueued Resource ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 with Priority: HIGHEST for action security_group_rules [ 874.371756] env[65783]: INFO networking_nsxv3.common.synchronization [req-1576d4c5-554d-4adf-9d99-e0d80407c984 req-8bfa12a8-77e8-45fd-93b7-6f5cd2af65d7 service nova] Enqueued Resource ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 with Priority: HIGHEST for action security_group_members [ 874.371899] env[65783]: INFO networking_nsxv3.common.synchronization [req-1576d4c5-554d-4adf-9d99-e0d80407c984 req-8bfa12a8-77e8-45fd-93b7-6f5cd2af65d7 service nova] Enqueued Resource ID: 680d08e3-6217-4e78-82fa-ea979448f95c with Priority: HIGHEST for action port [ 874.372617] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 with Priority: HIGHEST for action security_group_rules [ 874.373409] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 with Priority: HIGHEST for action security_group_members [ 874.373745] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 680d08e3-6217-4e78-82fa-ea979448f95c with Priority: HIGHEST for action port [ 874.373924] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74220b44-588c-49ac-81cc-e6ac2b7c6024 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.374127] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.375415] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-74220b44-588c-49ac-81cc-e6ac2b7c6024 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.375415] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.375415] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-680d08e3-6217-4e78-82fa-ea979448f95c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.375415] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-680d08e3-6217-4e78-82fa-ea979448f95c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.375415] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-680d08e3-6217-4e78-82fa-ea979448f95c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.375415] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-680d08e3-6217-4e78-82fa-ea979448f95c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.375415] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('680d08e3-6217-4e78-82fa-ea979448f95c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.876612] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 680d08e3-6217-4e78-82fa-ea979448f95c with status ACTIVE [ 874.876918] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.877106] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.877193] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.877484] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.877551] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.877766] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.877880] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.877947] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.878128] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.878208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.878392] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.878511] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.878592] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.878724] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.878824] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.878878] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 680d08e3-6217-4e78-82fa-ea979448f95c is going to be updated. [ 874.906710] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.906710] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.906710] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.906710] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.906710] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.906963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-680d08e3-6217-4e78-82fa-ea979448f95c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.438962] env[65783]: INFO networking_nsxv3.common.synchronization [req-d724b288-4763-411c-ab81-b200fd6ad454 req-b13cf4f0-2de9-4191-968d-c7b94822f094 tempest-AttachInterfacesV270Test-88998432 tempest-AttachInterfacesV270Test-88998432-project-member] Enqueued Resource ID: 3672e01a-c2d7-4bab-8a43-04160e095ad1 with Priority: HIGHEST for action security_group_members [ 875.441036] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3672e01a-c2d7-4bab-8a43-04160e095ad1 with Priority: HIGHEST for action security_group_members [ 875.441036] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3672e01a-c2d7-4bab-8a43-04160e095ad1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.441036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.441036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.441036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.441036] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.441036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.441506] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.441506] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.441506] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.442820] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3672e01a-c2d7-4bab-8a43-04160e095ad1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.823568] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-848 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.823833] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-848" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.823962] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-848" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.824357] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-848" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.824634] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.824790] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.824902] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.825134] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.825273] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.825471] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 875.825579] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 875.825695] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 875.825799] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 875.825904] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 875.826015] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 875.826156] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 875.845375] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 875.845537] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 875.845672] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 875.845843] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-848" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.846159] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-421c2150-8fa1-4607-a700-cba48466f00a taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.846339] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-421c2150-8fa1-4607-a700-cba48466f00a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.846444] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-421c2150-8fa1-4607-a700-cba48466f00a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.846943] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-421c2150-8fa1-4607-a700-cba48466f00a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.846943] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('421c2150-8fa1-4607-a700-cba48466f00a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.944414] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.944600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.944671] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.944886] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.944978] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.945215] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.945299] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.945367] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.945524] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.945603] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.945688] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3672e01a-c2d7-4bab-8a43-04160e095ad1 already deleted. [ 875.945772] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.103028] env[65783]: INFO networking_nsxv3.common.synchronization [None req-dd5bd160-b713-4683-8e87-3b3f30fa2bc6 None None] Enqueued Resource ID: 553718b9-2cbf-4ba1-b67f-33cefc4b41c1 with Priority: HIGHEST for action port [ 876.104167] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 553718b9-2cbf-4ba1-b67f-33cefc4b41c1 with Priority: HIGHEST for action port [ 876.104167] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-553718b9-2cbf-4ba1-b67f-33cefc4b41c1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.104167] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-553718b9-2cbf-4ba1-b67f-33cefc4b41c1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.104451] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-553718b9-2cbf-4ba1-b67f-33cefc4b41c1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.105152] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-553718b9-2cbf-4ba1-b67f-33cefc4b41c1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.105152] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('553718b9-2cbf-4ba1-b67f-33cefc4b41c1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.210012] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 in Status: IN_PROGRESS for 4s [ 876.350758] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.350992] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.351134] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.351434] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.351576] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.351728] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 421c2150-8fa1-4607-a700-cba48466f00a not found, creating... [ 876.352022] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.352209] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.352325] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.352552] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.352687] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.353034] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.353188] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.353312] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.353521] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.353651] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.353784] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 421c2150-8fa1-4607-a700-cba48466f00a is going to be created. [ 876.376586] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.376800] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.376922] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.377254] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.377549] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.377785] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-421c2150-8fa1-4607-a700-cba48466f00a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.609841] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 553718b9-2cbf-4ba1-b67f-33cefc4b41c1 [ 876.609841] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.609841] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.609841] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.609841] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.609841] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.609841] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:553718b9-2cbf-4ba1-b67f-33cefc4b41c1 already deleted. [ 876.609841] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-553718b9-2cbf-4ba1-b67f-33cefc4b41c1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.708438] env[65783]: INFO networking_nsxv3.common.synchronization [req-f0b0f716-4fbc-4ad6-8332-ee5e12c3b08c req-90a2880e-993f-4a96-9773-e83f810ec408 tempest-ServersAdminTestJSON-345343376 tempest-ServersAdminTestJSON-345343376-project-member] Enqueued Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_members [ 876.708975] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_members [ 876.709315] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca99b1a6-3702-4011-942b-06036fda2165 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.709439] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.709504] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.709694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.709846] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.709947] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.710016] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.710167] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.710249] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.710338] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.141253] env[65783]: INFO networking_nsxv3.common.synchronization [req-d724b288-4763-411c-ab81-b200fd6ad454 req-37a49c81-15e4-4b69-ba6f-14542311a845 service nova] Enqueued Resource ID: 3672e01a-c2d7-4bab-8a43-04160e095ad1 with Priority: HIGHEST for action security_group_rules [ 877.141757] env[65783]: INFO networking_nsxv3.common.synchronization [req-d724b288-4763-411c-ab81-b200fd6ad454 req-37a49c81-15e4-4b69-ba6f-14542311a845 service nova] Enqueued Resource ID: 3672e01a-c2d7-4bab-8a43-04160e095ad1 with Priority: HIGHEST for action security_group_members [ 877.141757] env[65783]: INFO networking_nsxv3.common.synchronization [req-d724b288-4763-411c-ab81-b200fd6ad454 req-37a49c81-15e4-4b69-ba6f-14542311a845 service nova] Enqueued Resource ID: 421c2150-8fa1-4607-a700-cba48466f00a with Priority: HIGHEST for action port [ 877.142563] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3672e01a-c2d7-4bab-8a43-04160e095ad1 with Priority: HIGHEST for action security_group_rules [ 877.143367] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3672e01a-c2d7-4bab-8a43-04160e095ad1 with Priority: HIGHEST for action security_group_members [ 877.143367] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 421c2150-8fa1-4607-a700-cba48466f00a with Priority: HIGHEST for action port [ 877.143663] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3672e01a-c2d7-4bab-8a43-04160e095ad1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.143859] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.144012] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.144423] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.144423] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3672e01a-c2d7-4bab-8a43-04160e095ad1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.145372] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3672e01a-c2d7-4bab-8a43-04160e095ad1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.146388] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.146388] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.146388] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.146388] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.146388] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.146388] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.147041] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.147179] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.147378] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3672e01a-c2d7-4bab-8a43-04160e095ad1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.151793] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-421c2150-8fa1-4607-a700-cba48466f00a taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.151793] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-421c2150-8fa1-4607-a700-cba48466f00a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.151793] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-421c2150-8fa1-4607-a700-cba48466f00a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.151793] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-421c2150-8fa1-4607-a700-cba48466f00a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.151793] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('421c2150-8fa1-4607-a700-cba48466f00a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.215655] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.651402] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3672e01a-c2d7-4bab-8a43-04160e095ad1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.652456] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3672e01a-c2d7-4bab-8a43-04160e095ad1 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.653057] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.653057] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 421c2150-8fa1-4607-a700-cba48466f00a with status ACTIVE [ 877.653057] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.653057] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.653239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.654068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.654068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.654068] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.654068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.654068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.654068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.654068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.654396] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.654396] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.654474] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.656207] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.656207] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.656207] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 421c2150-8fa1-4607-a700-cba48466f00a is going to be updated. [ 877.677943] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.678110] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.678211] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.678463] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.678597] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.678757] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-421c2150-8fa1-4607-a700-cba48466f00a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.717721] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.156894] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3672e01a-c2d7-4bab-8a43-04160e095ad1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.220621] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.220621] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.222822] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.222822] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.222822] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.222822] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca99b1a6-3702-4011-942b-06036fda2165 is going to be updated. [ 878.223667] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 in Status: SUCCESS [ 878.224077] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.225165] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.225712] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.225985] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.226204] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.226299] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.226534] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.226706] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.226858] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.270703] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.270703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.270703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.270703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.270703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.282814] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: IN_PROGRESS for 2s [ 878.407354] env[65783]: INFO networking_nsxv3.common.synchronization [None req-ada9baf2-6f4a-4af9-8dcc-28bf9456412b None None] Enqueued Resource ID: 7a15e333-22b1-4a22-8963-909ff5e60351 with Priority: HIGHEST for action port [ 878.408240] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a15e333-22b1-4a22-8963-909ff5e60351 with Priority: HIGHEST for action port [ 878.408736] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a15e333-22b1-4a22-8963-909ff5e60351 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.409692] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a15e333-22b1-4a22-8963-909ff5e60351" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.409692] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a15e333-22b1-4a22-8963-909ff5e60351" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.410236] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a15e333-22b1-4a22-8963-909ff5e60351" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.410370] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a15e333-22b1-4a22-8963-909ff5e60351',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.664454] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.664454] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.664454] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.664454] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.664454] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.664454] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3672e01a-c2d7-4bab-8a43-04160e095ad1 is going to be created. [ 878.690167] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.690813] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.690813] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.690813] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.690813] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.703463] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3672e01a-c2d7-4bab-8a43-04160e095ad1 in Status: UNINITIALIZED for 2s [ 878.730041] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.914037] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7a15e333-22b1-4a22-8963-909ff5e60351 [ 878.914037] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.914365] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.914365] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.914484] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.914573] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.914669] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7a15e333-22b1-4a22-8963-909ff5e60351 already deleted. [ 878.914748] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a15e333-22b1-4a22-8963-909ff5e60351" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.233378] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.237485] env[65783]: INFO networking_nsxv3.common.synchronization [None req-d1d29b84-14cc-49fe-b8b9-152eb3a8a51d tempest-ServerDiskConfigTestJSON-664757069 tempest-ServerDiskConfigTestJSON-664757069-project-member] Enqueued Resource ID: 858e7ba3-02e9-4d2b-9608-73683cbc4c78 with Priority: HIGHEST for action security_group_rules [ 879.238115] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858e7ba3-02e9-4d2b-9608-73683cbc4c78 with Priority: HIGHEST for action security_group_rules [ 879.238514] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-858e7ba3-02e9-4d2b-9608-73683cbc4c78 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.238645] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-858e7ba3-02e9-4d2b-9608-73683cbc4c78" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.238723] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-858e7ba3-02e9-4d2b-9608-73683cbc4c78" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.239075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-858e7ba3-02e9-4d2b-9608-73683cbc4c78" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.239173] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('858e7ba3-02e9-4d2b-9608-73683cbc4c78',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.340493] env[65783]: INFO networking_nsxv3.common.synchronization [None req-b1d9e505-e959-4456-b8ac-8dbd2a8379ba tempest-ServerDiskConfigTestJSON-664757069 tempest-ServerDiskConfigTestJSON-664757069-project-member] Enqueued Resource ID: 858e7ba3-02e9-4d2b-9608-73683cbc4c78 with Priority: HIGHEST for action security_group_rules [ 879.341026] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858e7ba3-02e9-4d2b-9608-73683cbc4c78 with Priority: HIGHEST for action security_group_rules [ 879.341156] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-858e7ba3-02e9-4d2b-9608-73683cbc4c78 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.341424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-858e7ba3-02e9-4d2b-9608-73683cbc4c78" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.736134] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.736479] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.736479] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.736572] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.736648] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.736743] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 is going to be updated. [ 879.759576] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.760102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.760489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.760926] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.761039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.761222] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 858e7ba3-02e9-4d2b-9608-73683cbc4c78 already deleted. [ 879.761309] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-858e7ba3-02e9-4d2b-9608-73683cbc4c78" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.761851] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-858e7ba3-02e9-4d2b-9608-73683cbc4c78" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.763178] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-858e7ba3-02e9-4d2b-9608-73683cbc4c78" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.763262] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('858e7ba3-02e9-4d2b-9608-73683cbc4c78',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.769494] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.769609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.769672] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.769877] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.769989] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.780105] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 in Status: IN_PROGRESS for 2s [ 880.213225] env[65783]: INFO networking_nsxv3.common.synchronization [req-9985588e-90d8-478f-9682-f85fb3633198 req-2583dd33-da5d-4463-882b-a76512d089b3 tempest-ServerAddressesTestJSON-2021451561 tempest-ServerAddressesTestJSON-2021451561-project-member] Enqueued Resource ID: 044a26f5-b666-44c4-8c58-085d6cf0af26 with Priority: HIGHEST for action security_group_members [ 880.213814] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 044a26f5-b666-44c4-8c58-085d6cf0af26 with Priority: HIGHEST for action security_group_members [ 880.214193] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-044a26f5-b666-44c4-8c58-085d6cf0af26 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.214329] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-044a26f5-b666-44c4-8c58-085d6cf0af26" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.214396] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-044a26f5-b666-44c4-8c58-085d6cf0af26" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.214594] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-044a26f5-b666-44c4-8c58-085d6cf0af26" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.214755] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.214867] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.214958] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.215395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.215488] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.215583] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('044a26f5-b666-44c4-8c58-085d6cf0af26',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.292455] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: SUCCESS [ 880.292715] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.293997] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.294171] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.294279] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.294551] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.294688] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.294815] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 858e7ba3-02e9-4d2b-9608-73683cbc4c78 already deleted. [ 880.294927] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-858e7ba3-02e9-4d2b-9608-73683cbc4c78" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.715103] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3672e01a-c2d7-4bab-8a43-04160e095ad1 in Status: SUCCESS [ 880.715359] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.715514] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.715732] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.715938] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.716041] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.716108] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.716252] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.716330] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.716411] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.716654] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3672e01a-c2d7-4bab-8a43-04160e095ad1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.717466] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.717574] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.717641] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.717790] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.717867] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.718047] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.718149] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.718211] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.718347] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.718420] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.718500] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 044a26f5-b666-44c4-8c58-085d6cf0af26 is going to be updated. [ 880.745038] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.745038] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.745038] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.745038] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.745038] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.753818] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 044a26f5-b666-44c4-8c58-085d6cf0af26 in Status: IN_PROGRESS for 2s [ 881.221276] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3672e01a-c2d7-4bab-8a43-04160e095ad1 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.221276] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.221276] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.221276] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.221276] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.221276] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.221276] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.221630] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.221630] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.221630] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.221704] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3672e01a-c2d7-4bab-8a43-04160e095ad1 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.222085] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.222085] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.222085] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.222269] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.222354] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.222423] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.222583] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.222645] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.222715] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.222801] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3672e01a-c2d7-4bab-8a43-04160e095ad1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.726258] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3672e01a-c2d7-4bab-8a43-04160e095ad1: rpc.has_security_group_logging(os_id): False [ 881.747399] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.747399] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.747399] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.747399] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.747399] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.747964] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.747964] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.747964] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.747964] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.747964] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.748135] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.748288] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.748383] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.748506] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.748579] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.748818] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.748918] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.748975] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.749384] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.749621] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.749621] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3672e01a-c2d7-4bab-8a43-04160e095ad1 is going to be created. [ 881.796590] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 in Status: SUCCESS [ 881.796590] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.796590] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.796590] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.796590] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.796590] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.796590] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.796590] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.796590] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.796590] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.816072] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.820079] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.820079] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.820079] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.820079] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.830813] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3672e01a-c2d7-4bab-8a43-04160e095ad1 in Status: IN_PROGRESS for 2s [ 882.299115] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.765048] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 044a26f5-b666-44c4-8c58-085d6cf0af26 in Status: SUCCESS [ 882.765313] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 044a26f5-b666-44c4-8c58-085d6cf0af26 deletion is rescheduled due to dependency. [ 882.765358] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-044a26f5-b666-44c4-8c58-085d6cf0af26" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.779462] env[65783]: INFO networking_nsxv3.common.synchronization [req-a7f8282b-4b8c-4942-a900-98cc3ff8c414 req-9f345019-29de-4c15-b174-4e617bcbe74f tempest-ServerDiskConfigTestJSON-664757069 tempest-ServerDiskConfigTestJSON-664757069-project-member] Enqueued Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 882.779588] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 882.779829] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.779942] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.780013] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.784244] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.784438] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.784551] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.785159] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.785159] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.785159] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.785159] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.805866] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.980392] env[65783]: INFO networking_nsxv3.common.synchronization [req-4c7e159a-ae47-4b23-9433-6f3b543b5822 req-c0dec60d-f4d5-4534-bd56-e210841da3de tempest-AttachVolumeTestJSON-999763968 tempest-AttachVolumeTestJSON-999763968-project-member] Enqueued Resource ID: 4a5d8777-50f6-4124-8014-838a921e8bd1 with Priority: HIGHEST for action security_group_members [ 882.981737] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a5d8777-50f6-4124-8014-838a921e8bd1 with Priority: HIGHEST for action security_group_members [ 882.982718] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a5d8777-50f6-4124-8014-838a921e8bd1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.982718] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a5d8777-50f6-4124-8014-838a921e8bd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.982718] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a5d8777-50f6-4124-8014-838a921e8bd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.982718] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a5d8777-50f6-4124-8014-838a921e8bd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.982718] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.983025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.983025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.983025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.983137] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.983313] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a5d8777-50f6-4124-8014-838a921e8bd1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.289054] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.289054] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.289165] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.289364] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.289430] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.289654] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.289736] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.289792] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.289963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.290041] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.290120] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 is going to be updated. [ 883.312214] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.312214] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.312214] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.312214] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.312214] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.312214] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 is going to be updated. [ 883.324764] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.324764] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.324764] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.324764] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.324764] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.335919] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: IN_PROGRESS for 2s [ 883.349882] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.350026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.350088] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.350339] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.350658] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.368491] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 in Status: IN_PROGRESS for 2s [ 883.395492] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-402 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.395708] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-402" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.395831] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-402" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.396182] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-402" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.396448] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.396605] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.396721] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.396936] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.397092] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.397298] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 883.397408] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 883.397514] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 883.397616] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 883.397722] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 883.397823] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 883.397961] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 883.461028] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 883.461298] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.063 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 883.461459] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 883.461621] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-402" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.461943] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-4ac3e7fa-b26e-4239-be70-ae1397fbba52 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.462234] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-4ac3e7fa-b26e-4239-be70-ae1397fbba52" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.462374] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-4ac3e7fa-b26e-4239-be70-ae1397fbba52" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.462792] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-4ac3e7fa-b26e-4239-be70-ae1397fbba52" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.462958] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ac3e7fa-b26e-4239-be70-ae1397fbba52',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.486775] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.486940] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.487019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.487250] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.487341] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.487549] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.487648] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.487743] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.487900] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.487945] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.488034] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a5d8777-50f6-4124-8014-838a921e8bd1 already deleted. [ 883.488098] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a5d8777-50f6-4124-8014-838a921e8bd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.845068] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3672e01a-c2d7-4bab-8a43-04160e095ad1 in Status: SUCCESS [ 883.845068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.966518] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.966737] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.967749] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.967749] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.967749] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.967749] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 4ac3e7fa-b26e-4239-be70-ae1397fbba52 not found, creating... [ 883.967749] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.968148] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.968148] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.968263] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.968322] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.968867] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.968867] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.968867] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.969115] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.969181] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.969330] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 4ac3e7fa-b26e-4239-be70-ae1397fbba52 is going to be created. [ 883.991722] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.991950] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.992140] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.992543] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.992787] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.993343] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-4ac3e7fa-b26e-4239-be70-ae1397fbba52" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.716490] env[65783]: INFO networking_nsxv3.common.synchronization [req-4c7e159a-ae47-4b23-9433-6f3b543b5822 req-0d3bc28b-28d3-4648-8e91-1dc722c510ee service nova] Enqueued Resource ID: 4a5d8777-50f6-4124-8014-838a921e8bd1 with Priority: HIGHEST for action security_group_rules [ 884.718020] env[65783]: INFO networking_nsxv3.common.synchronization [req-4c7e159a-ae47-4b23-9433-6f3b543b5822 req-0d3bc28b-28d3-4648-8e91-1dc722c510ee service nova] Enqueued Resource ID: 4a5d8777-50f6-4124-8014-838a921e8bd1 with Priority: HIGHEST for action security_group_members [ 884.718020] env[65783]: INFO networking_nsxv3.common.synchronization [req-4c7e159a-ae47-4b23-9433-6f3b543b5822 req-0d3bc28b-28d3-4648-8e91-1dc722c510ee service nova] Enqueued Resource ID: 4ac3e7fa-b26e-4239-be70-ae1397fbba52 with Priority: HIGHEST for action port [ 884.718020] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a5d8777-50f6-4124-8014-838a921e8bd1 with Priority: HIGHEST for action security_group_rules [ 884.718020] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a5d8777-50f6-4124-8014-838a921e8bd1 with Priority: HIGHEST for action security_group_members [ 884.718020] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ac3e7fa-b26e-4239-be70-ae1397fbba52 with Priority: HIGHEST for action port [ 884.718020] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a5d8777-50f6-4124-8014-838a921e8bd1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.718020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a5d8777-50f6-4124-8014-838a921e8bd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.718020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a5d8777-50f6-4124-8014-838a921e8bd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.718494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a5d8777-50f6-4124-8014-838a921e8bd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.718577] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a5d8777-50f6-4124-8014-838a921e8bd1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.722170] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a5d8777-50f6-4124-8014-838a921e8bd1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.722170] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a5d8777-50f6-4124-8014-838a921e8bd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.722170] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a5d8777-50f6-4124-8014-838a921e8bd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.722170] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a5d8777-50f6-4124-8014-838a921e8bd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.722170] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.722170] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.722170] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.722170] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.722170] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.722170] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a5d8777-50f6-4124-8014-838a921e8bd1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.723457] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ac3e7fa-b26e-4239-be70-ae1397fbba52 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.723594] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ac3e7fa-b26e-4239-be70-ae1397fbba52" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.723673] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ac3e7fa-b26e-4239-be70-ae1397fbba52" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.724757] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ac3e7fa-b26e-4239-be70-ae1397fbba52" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.724839] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ac3e7fa-b26e-4239-be70-ae1397fbba52',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.107861] env[65783]: INFO networking_nsxv3.common.synchronization [req-0162f957-b2db-45da-8296-41433bd74946 req-49c7b47b-fc28-4bbe-b6b2-ef1bd422f7e3 tempest-ImagesOneServerNegativeTestJSON-1524253690 tempest-ImagesOneServerNegativeTestJSON-1524253690-project-member] Enqueued Resource ID: 6432899c-b0aa-4285-971f-16ac27b1305b with Priority: HIGHEST for action security_group_members [ 885.108562] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6432899c-b0aa-4285-971f-16ac27b1305b with Priority: HIGHEST for action security_group_members [ 885.109622] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-6432899c-b0aa-4285-971f-16ac27b1305b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.109622] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.109622] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.109622] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.109622] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.109911] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.109911] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.109911] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.110013] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.110044] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6432899c-b0aa-4285-971f-16ac27b1305b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.226932] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a5d8777-50f6-4124-8014-838a921e8bd1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.228093] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a5d8777-50f6-4124-8014-838a921e8bd1 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.228290] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a5d8777-50f6-4124-8014-838a921e8bd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.230629] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4ac3e7fa-b26e-4239-be70-ae1397fbba52 with status ACTIVE [ 885.230629] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.230629] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.230629] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.230629] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.230629] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.230629] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.230629] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.230629] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.230629] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.230629] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.230629] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.230629] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.230629] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.230629] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.230629] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.230629] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4ac3e7fa-b26e-4239-be70-ae1397fbba52 is going to be updated. [ 885.257150] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.257150] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.257150] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.257150] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.257150] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.257150] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ac3e7fa-b26e-4239-be70-ae1397fbba52" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.346722] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: SUCCESS [ 885.346987] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 deletion is rescheduled due to dependency. [ 885.347153] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.390982] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 in Status: SUCCESS [ 885.391699] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.392115] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.393125] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.393125] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.393125] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.393125] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.393412] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.393546] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.393694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.393978] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-74220b44-588c-49ac-81cc-e6ac2b7c6024 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.394132] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.394228] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.394458] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.394699] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.394859] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.394957] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.395206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.395325] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.395523] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.395606] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.396963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.397195] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.398266] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.398266] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.398266] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.398266] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.398266] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.398266] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.588900] env[65783]: INFO networking_nsxv3.common.synchronization [req-6dfdfb8f-98b0-4647-97af-5f46c1519f89 req-8e1bd37d-b751-4cdc-abf4-f564c00977e8 tempest-ServersNegativeTestJSON-460036087 tempest-ServersNegativeTestJSON-460036087-project-member] Enqueued Resource ID: a938b55d-b711-4079-9f7b-f27235895480 with Priority: HIGHEST for action security_group_members [ 885.589881] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a938b55d-b711-4079-9f7b-f27235895480 with Priority: HIGHEST for action security_group_members [ 885.590339] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a938b55d-b711-4079-9f7b-f27235895480 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.590558] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.590696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.591023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.591306] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.591511] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.591775] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.592114] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.592266] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.592437] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.615226] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.615226] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.615226] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.615226] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.615226] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.615226] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.615226] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.615226] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.615226] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.615226] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.615226] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6432899c-b0aa-4285-971f-16ac27b1305b is going to be updated. [ 885.650881] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.651061] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.651269] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.651561] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.651735] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.661777] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6432899c-b0aa-4285-971f-16ac27b1305b in Status: IN_PROGRESS for 2s [ 885.730364] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a5d8777-50f6-4124-8014-838a921e8bd1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.901188] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 74220b44-588c-49ac-81cc-e6ac2b7c6024: rpc.has_security_group_logging(os_id): False [ 885.902425] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.926026] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.926135] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.926135] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.926452] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.926452] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.926979] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.926979] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.926979] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.926979] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.927169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.927384] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.927509] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.927552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.927691] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.927757] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.928154] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.928154] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.928154] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.928302] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.928329] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.928406] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 is going to be created. [ 885.938445] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-403 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.938652] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-403" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.938775] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-403" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.939043] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-403" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.939299] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.939453] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.939565] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.939769] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.940342] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.940689] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 885.940820] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 885.940928] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 885.941048] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 885.941161] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 885.941307] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 885.941452] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 885.969746] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 885.969997] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 885.969997] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 885.970349] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-403" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.970599] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-d6457e25-41bd-486e-bd24-5ec2f17cfbb3 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.970700] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-d6457e25-41bd-486e-bd24-5ec2f17cfbb3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.970980] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-d6457e25-41bd-486e-bd24-5ec2f17cfbb3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.971547] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-d6457e25-41bd-486e-bd24-5ec2f17cfbb3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.971547] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6457e25-41bd-486e-bd24-5ec2f17cfbb3',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.007504] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.007659] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.007788] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.008020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.008203] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.019134] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 in Status: IN_PROGRESS for 2s [ 886.095600] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.235933] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.235933] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.235933] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.236407] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.236407] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.236407] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a5d8777-50f6-4124-8014-838a921e8bd1 is going to be created. [ 886.266286] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.266461] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.266535] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.266775] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.266931] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.286547] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a5d8777-50f6-4124-8014-838a921e8bd1 in Status: UNINITIALIZED for 2s [ 886.406664] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.478023] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.478023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.478023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.478023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.478023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.478023] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port d6457e25-41bd-486e-bd24-5ec2f17cfbb3 not found, creating... [ 886.478023] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.478023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.478023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.478023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.478023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.478497] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.478497] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.478497] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.478497] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.479150] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.479627] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: d6457e25-41bd-486e-bd24-5ec2f17cfbb3 is going to be created. [ 886.502605] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.502605] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.502605] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.502605] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.502605] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.502605] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-d6457e25-41bd-486e-bd24-5ec2f17cfbb3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.597815] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.911109] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.911109] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.911109] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.911109] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.911109] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.911109] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 is going to be updated. [ 886.942846] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.943020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.943195] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.943499] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.945402] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.957122] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 in Status: IN_PROGRESS for 2s [ 887.100906] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.101796] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.101796] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.101796] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.101796] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.101796] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a938b55d-b711-4079-9f7b-f27235895480 is going to be updated. [ 887.142760] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.143013] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.143013] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.143215] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.143387] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.154283] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a938b55d-b711-4079-9f7b-f27235895480 in Status: IN_PROGRESS for 2s [ 887.278361] env[65783]: INFO networking_nsxv3.common.synchronization [req-6dfdfb8f-98b0-4647-97af-5f46c1519f89 req-ef8203e1-0550-406e-89d7-e75dd344ed74 service nova] Enqueued Resource ID: a938b55d-b711-4079-9f7b-f27235895480 with Priority: HIGHEST for action security_group_rules [ 887.280608] env[65783]: INFO networking_nsxv3.common.synchronization [req-6dfdfb8f-98b0-4647-97af-5f46c1519f89 req-ef8203e1-0550-406e-89d7-e75dd344ed74 service nova] Enqueued Resource ID: a938b55d-b711-4079-9f7b-f27235895480 with Priority: HIGHEST for action security_group_members [ 887.280805] env[65783]: INFO networking_nsxv3.common.synchronization [req-6dfdfb8f-98b0-4647-97af-5f46c1519f89 req-ef8203e1-0550-406e-89d7-e75dd344ed74 service nova] Enqueued Resource ID: d6457e25-41bd-486e-bd24-5ec2f17cfbb3 with Priority: HIGHEST for action port [ 887.281563] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a938b55d-b711-4079-9f7b-f27235895480 with Priority: HIGHEST for action security_group_rules [ 887.281563] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a938b55d-b711-4079-9f7b-f27235895480 with Priority: HIGHEST for action security_group_members [ 887.281752] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6457e25-41bd-486e-bd24-5ec2f17cfbb3 with Priority: HIGHEST for action port [ 887.281890] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a938b55d-b711-4079-9f7b-f27235895480 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.282026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.282155] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.282638] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.282638] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.283436] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a938b55d-b711-4079-9f7b-f27235895480 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.283520] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.283708] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6457e25-41bd-486e-bd24-5ec2f17cfbb3 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.283799] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6457e25-41bd-486e-bd24-5ec2f17cfbb3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.283865] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6457e25-41bd-486e-bd24-5ec2f17cfbb3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.284112] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6457e25-41bd-486e-bd24-5ec2f17cfbb3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.284153] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6457e25-41bd-486e-bd24-5ec2f17cfbb3',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.672617] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6432899c-b0aa-4285-971f-16ac27b1305b in Status: SUCCESS [ 887.672829] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6432899c-b0aa-4285-971f-16ac27b1305b deletion is rescheduled due to dependency. [ 887.673226] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.785846] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a938b55d-b711-4079-9f7b-f27235895480 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.786061] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.786151] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6457e25-41bd-486e-bd24-5ec2f17cfbb3 with status ACTIVE [ 887.786285] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.786381] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.786456] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.786658] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.786740] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.786903] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.787030] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.787119] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.787259] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.787259] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.787443] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.787553] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.787700] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.787700] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.787841] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.787841] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6457e25-41bd-486e-bd24-5ec2f17cfbb3 is going to be updated. [ 887.813142] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.813353] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.813424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.813627] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.813759] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.813914] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6457e25-41bd-486e-bd24-5ec2f17cfbb3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.033764] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 in Status: SUCCESS [ 888.033996] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.034205] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.034458] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.034548] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.217675] env[65783]: INFO networking_nsxv3.common.synchronization [req-f834b40a-41e6-43cb-9cb1-c97339c206be req-d4b1670b-26f3-4359-aade-f4f986ce72a2 tempest-ImagesTestJSON-433702528 tempest-ImagesTestJSON-433702528-project-member] Enqueued Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 888.218434] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 888.218993] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.218993] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.219221] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.219399] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.219566] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.219679] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.219726] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.219882] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.219966] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.220160] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.298247] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a5d8777-50f6-4124-8014-838a921e8bd1 in Status: SUCCESS [ 888.298680] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a5d8777-50f6-4124-8014-838a921e8bd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.298680] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a5d8777-50f6-4124-8014-838a921e8bd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.298832] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a5d8777-50f6-4124-8014-838a921e8bd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.299039] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.299171] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.299228] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.299804] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.299902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.300013] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a5d8777-50f6-4124-8014-838a921e8bd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.300114] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4a5d8777-50f6-4124-8014-838a921e8bd1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.538670] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-74220b44-588c-49ac-81cc-e6ac2b7c6024 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.538829] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.592743] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-509 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.592837] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-509" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.592953] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-509" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.593450] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-509" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.593728] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.593889] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.594019] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.596786] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.596786] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.596786] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 888.596786] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 888.596786] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 888.596786] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 888.596786] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 888.596786] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 888.596786] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 888.621439] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 888.621603] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 888.622012] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 888.622012] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-509" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.623302] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-08be336c-c7bd-448b-b11d-931b7e9788c9 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.623302] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-08be336c-c7bd-448b-b11d-931b7e9788c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.623302] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-08be336c-c7bd-448b-b11d-931b7e9788c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.623302] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-08be336c-c7bd-448b-b11d-931b7e9788c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.623614] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08be336c-c7bd-448b-b11d-931b7e9788c9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.722426] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.803863] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4a5d8777-50f6-4124-8014-838a921e8bd1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.970036] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 in Status: SUCCESS [ 888.970036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.970036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.970271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.970365] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.970523] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.970556] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.970731] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.970826] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.970930] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.971034] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.126395] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.126831] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.126981] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.127417] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.127563] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.127770] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 08be336c-c7bd-448b-b11d-931b7e9788c9 not found, creating... [ 889.128052] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.128406] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.128539] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.128873] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.129019] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.129318] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.129532] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.129597] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.129786] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.129916] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.130069] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 08be336c-c7bd-448b-b11d-931b7e9788c9 is going to be created. [ 889.152942] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.153209] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.153346] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.153668] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.153862] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.154107] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-08be336c-c7bd-448b-b11d-931b7e9788c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.164325] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a938b55d-b711-4079-9f7b-f27235895480 in Status: SUCCESS [ 889.164609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.164792] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.165022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.165220] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.165335] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.165400] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.165557] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.165639] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.165735] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.225341] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.306380] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4a5d8777-50f6-4124-8014-838a921e8bd1: rpc.has_security_group_logging(os_id): False [ 889.332549] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.332860] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.332860] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.333123] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.333207] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.333486] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.333599] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.333653] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.333798] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.333890] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.333977] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a5d8777-50f6-4124-8014-838a921e8bd1 is going to be created. [ 889.419325] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.419325] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.419325] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.419325] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.419592] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.436547] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a5d8777-50f6-4124-8014-838a921e8bd1 in Status: IN_PROGRESS for 2s [ 889.474276] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-74220b44-588c-49ac-81cc-e6ac2b7c6024 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.474594] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.474703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.474906] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.475091] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.475348] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.475348] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.475620] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.475620] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.475690] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.475794] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-74220b44-588c-49ac-81cc-e6ac2b7c6024 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.475891] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.475951] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.476111] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.476341] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.476341] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.476432] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.476536] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.476610] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.476689] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.476780] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.668153] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.728246] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.728657] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.728657] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.728918] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.728990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.729095] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd942bf-b305-4707-8084-1ac6b135c741 is going to be updated. [ 889.762883] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.763058] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.763128] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.763374] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.763565] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.775039] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: IN_PROGRESS for 2s [ 889.865896] env[65783]: INFO networking_nsxv3.common.synchronization [req-f834b40a-41e6-43cb-9cb1-c97339c206be req-595cb081-bd7a-4dd8-b072-79380afbf02c service nova] Enqueued Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_rules [ 889.865896] env[65783]: INFO networking_nsxv3.common.synchronization [req-f834b40a-41e6-43cb-9cb1-c97339c206be req-595cb081-bd7a-4dd8-b072-79380afbf02c service nova] Enqueued Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 889.865896] env[65783]: INFO networking_nsxv3.common.synchronization [req-f834b40a-41e6-43cb-9cb1-c97339c206be req-595cb081-bd7a-4dd8-b072-79380afbf02c service nova] Enqueued Resource ID: 08be336c-c7bd-448b-b11d-931b7e9788c9 with Priority: HIGHEST for action port [ 889.866379] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_rules [ 889.866530] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 889.866603] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08be336c-c7bd-448b-b11d-931b7e9788c9 with Priority: HIGHEST for action port [ 889.867345] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.867345] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.867345] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.867345] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.867345] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.868359] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.868508] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.868665] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-08be336c-c7bd-448b-b11d-931b7e9788c9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.868721] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08be336c-c7bd-448b-b11d-931b7e9788c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.868786] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08be336c-c7bd-448b-b11d-931b7e9788c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.868946] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08be336c-c7bd-448b-b11d-931b7e9788c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.871059] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08be336c-c7bd-448b-b11d-931b7e9788c9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.978952] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 74220b44-588c-49ac-81cc-e6ac2b7c6024: rpc.has_security_group_logging(os_id): False [ 889.997025] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.997224] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.997382] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.997446] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.997541] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.997731] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.997828] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.997889] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.998046] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.998124] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.998313] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.998404] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.998460] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.998608] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.998678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.998857] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.998948] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.999016] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.999155] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.999230] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.999312] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 is going to be updated. [ 890.059585] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.059761] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.059797] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.060038] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.060182] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.071112] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 in Status: IN_PROGRESS for 2s [ 890.171510] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.370652] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.370946] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.373229] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08be336c-c7bd-448b-b11d-931b7e9788c9 with status ACTIVE [ 890.373441] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.373637] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.373709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.373920] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.374019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.374192] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.374291] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.374352] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.374502] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.374578] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.374752] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.374843] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.374904] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.375051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.375124] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.375226] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08be336c-c7bd-448b-b11d-931b7e9788c9 is going to be updated. [ 890.399819] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.399975] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.400045] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.400287] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.400424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.400583] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08be336c-c7bd-448b-b11d-931b7e9788c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.675449] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.675638] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.675720] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.675963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.676064] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.676162] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a938b55d-b711-4079-9f7b-f27235895480 is going to be updated. [ 890.715248] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.715248] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.715248] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.715248] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.715248] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.724108] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a938b55d-b711-4079-9f7b-f27235895480 in Status: IN_PROGRESS for 2s [ 890.774243] env[65783]: INFO networking_nsxv3.common.synchronization [req-20d7ca54-ee68-4020-844b-47b0d6915d26 req-68cf5ef6-ce80-497a-bd06-1ce1afa9ba93 tempest-DeleteServersTestJSON-1456685968 tempest-DeleteServersTestJSON-1456685968-project-member] Enqueued Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 890.774405] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 890.774726] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.774906] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.774906] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.775506] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.775715] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.775869] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.775926] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.776144] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.776241] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.776338] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.168185] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-131 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.168423] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-131" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.168549] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-131" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.168935] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-131" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.169266] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.169454] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.169661] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.170039] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.170203] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.170452] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 891.170570] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 891.170767] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 891.170802] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 891.170884] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 891.170993] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 891.171134] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 891.193419] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 891.193644] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 891.193733] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 891.193912] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-131" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.194285] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-987d7302-963a-4e9f-abaf-6d560099bdbc taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.194475] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-987d7302-963a-4e9f-abaf-6d560099bdbc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.194591] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-987d7302-963a-4e9f-abaf-6d560099bdbc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.194922] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-987d7302-963a-4e9f-abaf-6d560099bdbc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.195080] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('987d7302-963a-4e9f-abaf-6d560099bdbc',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.281036] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.281036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.281036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.281036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.281036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.281036] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.281036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.281036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.281036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.281036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.281036] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 is going to be updated. [ 891.321525] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.321525] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.321525] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.321791] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.321953] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.332577] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: IN_PROGRESS for 2s [ 891.449730] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a5d8777-50f6-4124-8014-838a921e8bd1 in Status: SUCCESS [ 891.449988] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a5d8777-50f6-4124-8014-838a921e8bd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.698714] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.698714] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.698714] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.698714] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.699010] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.699010] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 987d7302-963a-4e9f-abaf-6d560099bdbc not found, creating... [ 891.699191] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.699341] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.699452] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.699671] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.699800] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.700088] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.700251] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.700449] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.700676] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.700805] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.700939] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 987d7302-963a-4e9f-abaf-6d560099bdbc is going to be created. [ 891.723669] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.723876] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.724007] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.724298] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.724548] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.724781] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-987d7302-963a-4e9f-abaf-6d560099bdbc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.791375] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: SUCCESS [ 891.791628] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.791813] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.792062] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.792395] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.792532] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.792594] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.792776] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.792856] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.792966] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.088468] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 in Status: SUCCESS [ 892.088701] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.088886] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.089140] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.089226] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.295644] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.491143] env[65783]: INFO networking_nsxv3.common.synchronization [req-20d7ca54-ee68-4020-844b-47b0d6915d26 req-ddba757d-cad0-4617-b7c6-b93bf13aecf7 service nova] Enqueued Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_rules [ 892.491143] env[65783]: INFO networking_nsxv3.common.synchronization [req-20d7ca54-ee68-4020-844b-47b0d6915d26 req-ddba757d-cad0-4617-b7c6-b93bf13aecf7 service nova] Enqueued Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 892.491143] env[65783]: INFO networking_nsxv3.common.synchronization [req-20d7ca54-ee68-4020-844b-47b0d6915d26 req-ddba757d-cad0-4617-b7c6-b93bf13aecf7 service nova] Enqueued Resource ID: 987d7302-963a-4e9f-abaf-6d560099bdbc with Priority: HIGHEST for action port [ 892.491599] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_rules [ 892.491736] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 892.491845] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 987d7302-963a-4e9f-abaf-6d560099bdbc with Priority: HIGHEST for action port [ 892.494181] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.494315] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.494423] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.494624] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.494711] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.495794] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.495906] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.496207] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-987d7302-963a-4e9f-abaf-6d560099bdbc taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.496350] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-987d7302-963a-4e9f-abaf-6d560099bdbc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.496420] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-987d7302-963a-4e9f-abaf-6d560099bdbc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.496656] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-987d7302-963a-4e9f-abaf-6d560099bdbc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.496784] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('987d7302-963a-4e9f-abaf-6d560099bdbc',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.591759] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-74220b44-588c-49ac-81cc-e6ac2b7c6024 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.591919] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.591991] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.592300] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.592470] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.592588] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.592662] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.592804] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.592889] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.593085] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.593149] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.735209] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a938b55d-b711-4079-9f7b-f27235895480 in Status: SUCCESS [ 892.735533] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.737110] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.737110] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.737110] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.737110] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.737110] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.737498] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.737498] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.737498] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.737498] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.800032] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.998443] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.998569] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.998837] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 987d7302-963a-4e9f-abaf-6d560099bdbc with status ACTIVE [ 892.998936] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.999047] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.999114] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.999336] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.999428] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.999603] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.999722] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.999856] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.999949] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.000042] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.000274] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.000375] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.000437] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.000592] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.000667] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.000750] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 987d7302-963a-4e9f-abaf-6d560099bdbc is going to be updated. [ 893.031166] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.031384] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.031524] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.031866] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.032074] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.032951] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-987d7302-963a-4e9f-abaf-6d560099bdbc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.098990] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-74220b44-588c-49ac-81cc-e6ac2b7c6024 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.099194] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.099247] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.099471] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.099649] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.099754] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.099820] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.099979] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.100181] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.100282] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.100539] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-74220b44-588c-49ac-81cc-e6ac2b7c6024 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.100640] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.100702] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.100851] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.100991] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.101099] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.101152] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.101290] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.101365] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.101446] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.101538] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.240345] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a938b55d-b711-4079-9f7b-f27235895480 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.240624] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.240624] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.240803] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.240976] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.241183] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.241183] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.241332] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.241408] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.241489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.241648] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a938b55d-b711-4079-9f7b-f27235895480 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.241740] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.241803] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.241933] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.242122] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.242253] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.242313] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.242484] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.242556] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.242657] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.242744] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.302160] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.302326] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.302406] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.302634] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.302728] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.302833] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd942bf-b305-4707-8084-1ac6b135c741 is going to be updated. [ 893.337014] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.337169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.337365] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.337511] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.337564] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.349582] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: IN_PROGRESS for 2s [ 893.350422] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: SUCCESS [ 893.350539] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 deletion is rescheduled due to dependency. [ 893.350588] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.350781] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.351087] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.351307] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.351459] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.351559] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.351738] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.351820] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.351919] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.610399] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 74220b44-588c-49ac-81cc-e6ac2b7c6024: rpc.has_security_group_logging(os_id): False [ 893.632185] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.632185] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.632185] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.632185] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.632473] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.632473] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.632552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.632581] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.633537] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.633537] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.633537] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.633537] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.633537] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.633537] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.633537] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.633843] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.633843] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.633843] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.633932] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.633932] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.634013] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 is going to be updated. [ 893.691152] env[65783]: INFO networking_nsxv3.common.synchronization [req-52481707-4957-4899-b9e8-e03c0df0bd1e req-42e8b060-caea-4fc0-a538-9c394c04a2c3 tempest-AttachInterfacesV270Test-88998432 tempest-AttachInterfacesV270Test-88998432-project-member] Enqueued Resource ID: 3672e01a-c2d7-4bab-8a43-04160e095ad1 with Priority: HIGHEST for action security_group_members [ 893.691730] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3672e01a-c2d7-4bab-8a43-04160e095ad1 with Priority: HIGHEST for action security_group_members [ 893.692067] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3672e01a-c2d7-4bab-8a43-04160e095ad1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.692250] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.692445] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.692549] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.692714] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.692812] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.692873] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.693089] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.693209] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.693331] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3672e01a-c2d7-4bab-8a43-04160e095ad1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.706836] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.707061] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.707061] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.707263] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.707401] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.722838] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 in Status: IN_PROGRESS for 2s [ 893.744614] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a938b55d-b711-4079-9f7b-f27235895480: rpc.has_security_group_logging(os_id): False [ 893.784883] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.784883] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.784883] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.784883] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.784883] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.784883] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.784883] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.786777] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.786777] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.786777] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.786777] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.786777] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.786777] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.786777] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.786777] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.786777] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.786777] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.786777] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.786777] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.786777] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.786777] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a938b55d-b711-4079-9f7b-f27235895480 is going to be updated. [ 893.853993] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.861170] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.861371] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.861444] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.862721] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.862721] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.876488] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a938b55d-b711-4079-9f7b-f27235895480 in Status: IN_PROGRESS for 2s [ 894.195983] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.196186] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.196306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.196593] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.196593] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.196736] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.196862] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.196862] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.197018] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.197133] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.197467] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3672e01a-c2d7-4bab-8a43-04160e095ad1 is going to be updated. [ 894.228212] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.228541] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.228609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.228820] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.229266] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.239024] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3672e01a-c2d7-4bab-8a43-04160e095ad1 in Status: IN_PROGRESS for 2s [ 894.358485] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.861694] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.862026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.862070] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.862385] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.862528] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.862666] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 is going to be updated. [ 894.899328] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.899587] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.899717] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.902881] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.902881] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.914209] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: IN_PROGRESS for 2s [ 895.365119] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: SUCCESS [ 895.365981] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.366197] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.368020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.368020] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.368020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.368020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.368020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.368020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.368020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.368020] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.742217] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 in Status: SUCCESS [ 895.742628] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.870736] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.871063] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.871063] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.871198] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.871365] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.871567] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.871687] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.871803] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.871886] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.871974] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.873049] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.873153] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.873245] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.873405] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.873551] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.873646] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.873717] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.873871] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.873948] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.874041] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.874130] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.892769] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a938b55d-b711-4079-9f7b-f27235895480 in Status: SUCCESS [ 895.893086] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.249695] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3672e01a-c2d7-4bab-8a43-04160e095ad1 in Status: SUCCESS [ 896.249876] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3672e01a-c2d7-4bab-8a43-04160e095ad1 deletion is rescheduled due to dependency. [ 896.249992] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.378055] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for efd942bf-b305-4707-8084-1ac6b135c741: rpc.has_security_group_logging(os_id): False [ 896.396810] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.396810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.396810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.396810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.396810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.396810] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.396810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.396810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.396810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.396810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.396810] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.396810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.396810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.396810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.396810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.397352] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.397352] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.397352] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.401881] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.402265] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.404360] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efd942bf-b305-4707-8084-1ac6b135c741 is going to be updated. [ 896.473687] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.474053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.474053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.474159] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.474257] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.487315] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: IN_PROGRESS for 2s [ 896.930321] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: SUCCESS [ 896.930653] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.930900] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.931122] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.931359] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.931508] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.931587] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.931785] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.931937] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.932072] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.932244] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.436213] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.436473] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.436545] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.436895] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.437124] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.437239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.437317] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.437584] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.437690] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.437806] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.438079] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.438293] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.438293] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.438470] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.438656] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.438788] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.438852] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.439075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.439075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.439174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.439264] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.616104] env[65783]: INFO networking_nsxv3.common.synchronization [req-d3c9283a-8b79-44a8-bf6f-36f67b2ea26d req-9a69c457-01b2-4f5a-8608-d3c9fcd68286 tempest-MigrationsAdminTest-1412758904 tempest-MigrationsAdminTest-1412758904-project-member] Enqueued Resource ID: b6e66254-5e43-437b-850b-825eaaa0cee1 with Priority: HIGHEST for action security_group_members [ 897.616824] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e66254-5e43-437b-850b-825eaaa0cee1 with Priority: HIGHEST for action security_group_members [ 897.617115] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6e66254-5e43-437b-850b-825eaaa0cee1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.617282] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.617385] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.617617] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.617812] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.617966] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.618079] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.620040] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.620040] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.620040] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6e66254-5e43-437b-850b-825eaaa0cee1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.942521] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a56944ee-f571-421e-aac3-fe1ac51a1fd9: rpc.has_security_group_logging(os_id): False [ 897.962331] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.962475] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.962520] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.962742] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.962826] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.963064] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.963215] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.963215] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.963445] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.963612] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.963706] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.963795] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.963852] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.963995] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.964124] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.964374] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.964725] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.965476] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.965476] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.965476] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.965476] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 is going to be updated. [ 898.045952] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.045952] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.045952] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.045952] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.045952] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.083397] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: IN_PROGRESS for 2s [ 898.120396] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.120580] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.120701] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.120886] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.152339] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.152636] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.152772] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.152840] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.153073] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.153186] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.153360] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6e66254-5e43-437b-850b-825eaaa0cee1 is going to be updated. [ 898.215598] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.215760] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.215832] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.216104] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.216254] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.233851] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6e66254-5e43-437b-850b-825eaaa0cee1 in Status: IN_PROGRESS for 2s [ 898.503251] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: SUCCESS [ 898.503513] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.102424] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: SUCCESS [ 900.102424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.245208] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6e66254-5e43-437b-850b-825eaaa0cee1 in Status: SUCCESS [ 900.245323] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6e66254-5e43-437b-850b-825eaaa0cee1 deletion is rescheduled due to dependency. [ 900.245432] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.418602] env[65783]: INFO networking_nsxv3.common.synchronization [req-1e2ada1d-63ef-4ec3-9d42-3353c319c202 req-9314ed1b-e99b-48e9-8642-d371b032ccf3 tempest-ServersNegativeTestJSON-460036087 tempest-ServersNegativeTestJSON-460036087-project-member] Enqueued Resource ID: a938b55d-b711-4079-9f7b-f27235895480 with Priority: HIGHEST for action security_group_members [ 901.419283] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a938b55d-b711-4079-9f7b-f27235895480 with Priority: HIGHEST for action security_group_members [ 901.419664] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a938b55d-b711-4079-9f7b-f27235895480 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.419818] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.419909] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.421246] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.421246] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.421341] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.421376] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.421537] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.421620] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.421717] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.915342] env[65783]: INFO networking_nsxv3.common.synchronization [req-c71fd517-4bd5-4f5e-abbb-931a44e1674b req-307d5315-7ba9-4410-ae44-716dc955c85d tempest-ListImageFiltersTestJSON-600591362 tempest-ListImageFiltersTestJSON-600591362-project-member] Enqueued Resource ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 with Priority: HIGHEST for action security_group_members [ 901.915958] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 with Priority: HIGHEST for action security_group_members [ 901.916775] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-177e22b5-9104-44ad-8e54-e2d4da7915c9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.917057] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.917185] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.917455] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.917633] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.917780] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.917853] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.918072] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.918173] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.918270] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('177e22b5-9104-44ad-8e54-e2d4da7915c9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.924876] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.342675] env[65783]: INFO networking_nsxv3.common.synchronization [req-a7c56727-d4a0-4734-945b-acbbe0bd6efe req-7261595c-453d-4d26-ab9c-7d69b7af235b tempest-ServerRescueTestJSONUnderV235-739854739 tempest-ServerRescueTestJSONUnderV235-739854739-project-member] Enqueued Resource ID: cbc55d75-4ce5-409b-958a-48efef735829 with Priority: HIGHEST for action security_group_members [ 902.343285] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc55d75-4ce5-409b-958a-48efef735829 with Priority: HIGHEST for action security_group_members [ 902.344041] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc55d75-4ce5-409b-958a-48efef735829 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.344041] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.344041] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.345830] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.346845] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.346845] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.346845] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.346845] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.346845] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.346845] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbc55d75-4ce5-409b-958a-48efef735829',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.425023] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.425023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.425023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.425023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.425023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.425023] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.426021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.426212] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.429029] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.429029] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.429029] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 is going to be updated. [ 902.429029] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.467493] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.467493] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.467493] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.467750] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.467906] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.479194] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 in Status: IN_PROGRESS for 2s [ 902.793457] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-542 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.793653] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-542" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.793776] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-542" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.794277] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-542" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.794382] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.794541] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.794657] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.794876] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.795376] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.795640] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 902.795749] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 902.795858] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 902.795962] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 902.796209] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 902.796375] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 902.796518] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 902.820731] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 902.820731] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 902.820731] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 902.820970] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-542" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.821454] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-891ac553-14f8-41d2-a6e4-c24ef3c62c6a taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.821454] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-891ac553-14f8-41d2-a6e4-c24ef3c62c6a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.821842] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-891ac553-14f8-41d2-a6e4-c24ef3c62c6a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.821842] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-891ac553-14f8-41d2-a6e4-c24ef3c62c6a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.822521] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('891ac553-14f8-41d2-a6e4-c24ef3c62c6a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.848949] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.849198] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.849198] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.849409] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.849494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.849819] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.849819] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.850034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.850034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.850087] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.850156] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbc55d75-4ce5-409b-958a-48efef735829 already deleted. [ 902.850248] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.931544] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.931720] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.931761] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.932040] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.932138] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.932296] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a938b55d-b711-4079-9f7b-f27235895480 is going to be updated. [ 902.965167] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.965381] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.965381] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.965600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.965748] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.976684] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a938b55d-b711-4079-9f7b-f27235895480 in Status: IN_PROGRESS for 2s [ 903.324666] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.324959] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.324959] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.325387] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.325593] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.325695] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 891ac553-14f8-41d2-a6e4-c24ef3c62c6a not found, creating... [ 903.326020] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.326270] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.326377] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.326527] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.326673] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.326972] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.328087] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.328087] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.328087] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.328087] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.328087] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 891ac553-14f8-41d2-a6e4-c24ef3c62c6a is going to be created. [ 903.358497] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.358799] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.358870] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.359233] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.359526] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.359838] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-891ac553-14f8-41d2-a6e4-c24ef3c62c6a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.064060] env[65783]: INFO networking_nsxv3.common.synchronization [req-a7c56727-d4a0-4734-945b-acbbe0bd6efe req-e25abb3e-b7e9-4509-9999-2c737a4e42a1 service nova] Enqueued Resource ID: cbc55d75-4ce5-409b-958a-48efef735829 with Priority: HIGHEST for action security_group_rules [ 904.064060] env[65783]: INFO networking_nsxv3.common.synchronization [req-a7c56727-d4a0-4734-945b-acbbe0bd6efe req-e25abb3e-b7e9-4509-9999-2c737a4e42a1 service nova] Enqueued Resource ID: cbc55d75-4ce5-409b-958a-48efef735829 with Priority: HIGHEST for action security_group_members [ 904.064060] env[65783]: INFO networking_nsxv3.common.synchronization [req-a7c56727-d4a0-4734-945b-acbbe0bd6efe req-e25abb3e-b7e9-4509-9999-2c737a4e42a1 service nova] Enqueued Resource ID: 891ac553-14f8-41d2-a6e4-c24ef3c62c6a with Priority: HIGHEST for action port [ 904.064060] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc55d75-4ce5-409b-958a-48efef735829 with Priority: HIGHEST for action security_group_rules [ 904.064060] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc55d75-4ce5-409b-958a-48efef735829 with Priority: HIGHEST for action security_group_members [ 904.064060] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 891ac553-14f8-41d2-a6e4-c24ef3c62c6a with Priority: HIGHEST for action port [ 904.065232] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbc55d75-4ce5-409b-958a-48efef735829 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.065797] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.065797] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.067044] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.067044] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbc55d75-4ce5-409b-958a-48efef735829',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.068023] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc55d75-4ce5-409b-958a-48efef735829 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.068134] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.068198] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.068367] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.068515] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.068631] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.068685] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.068838] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.068930] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.069017] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbc55d75-4ce5-409b-958a-48efef735829',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.070178] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-891ac553-14f8-41d2-a6e4-c24ef3c62c6a taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.070292] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-891ac553-14f8-41d2-a6e4-c24ef3c62c6a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.070386] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-891ac553-14f8-41d2-a6e4-c24ef3c62c6a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.072074] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-891ac553-14f8-41d2-a6e4-c24ef3c62c6a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.072074] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('891ac553-14f8-41d2-a6e4-c24ef3c62c6a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.491727] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 in Status: SUCCESS [ 904.491727] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 deletion is rescheduled due to dependency. [ 904.491727] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.573830] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc55d75-4ce5-409b-958a-48efef735829 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.573979] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.574203] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbc55d75-4ce5-409b-958a-48efef735829',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.575296] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 891ac553-14f8-41d2-a6e4-c24ef3c62c6a with status ACTIVE [ 904.575530] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.575706] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.575808] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.576126] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.576269] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.576503] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.576631] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.576698] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.576864] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.576942] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.579020] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.579145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.579231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.579379] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.579460] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.579579] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 891ac553-14f8-41d2-a6e4-c24ef3c62c6a is going to be updated. [ 904.600792] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.600922] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.600991] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.601211] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.601346] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.601500] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-891ac553-14f8-41d2-a6e4-c24ef3c62c6a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.988614] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a938b55d-b711-4079-9f7b-f27235895480 in Status: SUCCESS [ 904.988920] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.081747] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbc55d75-4ce5-409b-958a-48efef735829',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.584470] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.584470] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.584470] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.585329] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.585329] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.585329] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbc55d75-4ce5-409b-958a-48efef735829 is going to be created. [ 905.610326] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.610504] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.610574] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.610828] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.611038] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.623318] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc55d75-4ce5-409b-958a-48efef735829 in Status: UNINITIALIZED for 2s [ 906.941294] env[65783]: INFO networking_nsxv3.common.synchronization [req-333b9acd-7dfd-43b1-afb3-1a119c572461 req-4befb539-df53-42a0-b0b7-acf7fb25e7bd tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_members [ 906.941682] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_members [ 906.942014] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.942491] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.942491] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.943709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.944476] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.944705] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.944799] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.945381] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.945381] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.945381] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.408180] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-287 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.409026] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-287" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.409026] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-287" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.409026] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-287" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.409470] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.409470] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.409604] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.409816] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.410011] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.410267] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 907.410409] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 907.410534] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 907.410606] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 907.410891] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 907.410891] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 907.411017] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 907.434182] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 907.434420] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 907.434662] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 907.435596] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-287" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.435596] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-85fbe51b-2508-45d1-a3e3-b6c38fac2060 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.435596] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-85fbe51b-2508-45d1-a3e3-b6c38fac2060" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.435860] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-85fbe51b-2508-45d1-a3e3-b6c38fac2060" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.436201] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-85fbe51b-2508-45d1-a3e3-b6c38fac2060" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.436344] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85fbe51b-2508-45d1-a3e3-b6c38fac2060',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.448123] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.448286] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.448364] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.448572] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.449012] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.449012] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.449177] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.449217] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.453027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.453027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.453027] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 already deleted. [ 907.453027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.634198] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc55d75-4ce5-409b-958a-48efef735829 in Status: SUCCESS [ 907.634560] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.634708] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.634968] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.635190] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.635349] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.635419] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.635546] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.635704] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.635826] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.635913] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cbc55d75-4ce5-409b-958a-48efef735829',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.709133] env[65783]: INFO networking_nsxv3.common.synchronization [req-3ccf998c-e5e2-4721-9754-abeb7610c3ce req-b8f94990-3793-4fcd-b9bd-76eb5fa24acc tempest-ServersAdminTestJSON-345343376 tempest-ServersAdminTestJSON-345343376-project-member] Enqueued Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_members [ 907.709707] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGHEST for action security_group_members [ 907.710082] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca99b1a6-3702-4011-942b-06036fda2165 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.710256] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.710348] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.710544] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.710742] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.710825] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.710888] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.711083] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.711195] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.711310] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.939027] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.939302] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.939415] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.939680] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.939826] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.939977] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 85fbe51b-2508-45d1-a3e3-b6c38fac2060 not found, creating... [ 907.940255] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.940414] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.940527] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.940777] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.940923] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.941225] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.941380] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.941668] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.941734] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.941811] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.941940] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 85fbe51b-2508-45d1-a3e3-b6c38fac2060 is going to be created. [ 907.966245] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.966245] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.966245] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.966245] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.966245] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.966837] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-85fbe51b-2508-45d1-a3e3-b6c38fac2060" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.140283] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc55d75-4ce5-409b-958a-48efef735829 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.140283] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.140283] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.140520] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.140680] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.140792] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.140896] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.141036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.141146] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.141309] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.141513] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc55d75-4ce5-409b-958a-48efef735829 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.141783] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.141783] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.141905] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.142113] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.142446] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.142446] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.142552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.142740] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.142797] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.142906] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cbc55d75-4ce5-409b-958a-48efef735829',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.214896] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.214896] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.214896] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.214896] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.244873] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.244873] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.244873] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.244873] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.244873] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.244873] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.244873] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca99b1a6-3702-4011-942b-06036fda2165 is going to be updated. [ 908.276672] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.276672] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.276672] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.276672] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.276672] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.286737] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: IN_PROGRESS for 2s [ 908.645817] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cbc55d75-4ce5-409b-958a-48efef735829: rpc.has_security_group_logging(os_id): False [ 908.664747] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.664945] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.665020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.665243] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.665308] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.665499] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.665614] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.665677] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.665828] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.665911] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.666979] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.666979] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.666979] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.666979] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.666979] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.666979] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.666979] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.666979] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.667679] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.667679] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.667679] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbc55d75-4ce5-409b-958a-48efef735829 is going to be created. [ 908.670633] env[65783]: INFO networking_nsxv3.common.synchronization [req-333b9acd-7dfd-43b1-afb3-1a119c572461 req-9bd6c8ff-a3d1-4424-9bde-238ed93937d1 service nova] Enqueued Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_rules [ 908.670862] env[65783]: INFO networking_nsxv3.common.synchronization [req-333b9acd-7dfd-43b1-afb3-1a119c572461 req-9bd6c8ff-a3d1-4424-9bde-238ed93937d1 service nova] Enqueued Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_members [ 908.671041] env[65783]: INFO networking_nsxv3.common.synchronization [req-333b9acd-7dfd-43b1-afb3-1a119c572461 req-9bd6c8ff-a3d1-4424-9bde-238ed93937d1 service nova] Enqueued Resource ID: 85fbe51b-2508-45d1-a3e3-b6c38fac2060 with Priority: HIGHEST for action port [ 908.672323] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_rules [ 908.672323] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_members [ 908.672323] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85fbe51b-2508-45d1-a3e3-b6c38fac2060 with Priority: HIGHEST for action port [ 908.672430] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.672502] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.672621] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.672993] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.672993] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.674047] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.674184] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.674254] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.674453] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.674654] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.674937] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.674937] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.674937] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.675198] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.675308] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.676453] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-85fbe51b-2508-45d1-a3e3-b6c38fac2060 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.676453] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85fbe51b-2508-45d1-a3e3-b6c38fac2060" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.676453] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85fbe51b-2508-45d1-a3e3-b6c38fac2060" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.676735] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85fbe51b-2508-45d1-a3e3-b6c38fac2060" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.676735] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85fbe51b-2508-45d1-a3e3-b6c38fac2060',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.749279] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.749459] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.753023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.753023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.753023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.764818] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbc55d75-4ce5-409b-958a-48efef735829 in Status: IN_PROGRESS for 2s [ 909.156675] env[65783]: INFO networking_nsxv3.common.synchronization [req-7455299b-7f23-4264-a6bb-18b090f143c2 req-c4b8c1ba-b36c-4a11-84ca-93284ce3ed6f tempest-ListServerFiltersTestJSON-326822078 tempest-ListServerFiltersTestJSON-326822078-project-member] Enqueued Resource ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 with Priority: HIGHEST for action security_group_members [ 909.156960] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 with Priority: HIGHEST for action security_group_members [ 909.157309] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-74220b44-588c-49ac-81cc-e6ac2b7c6024 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.157437] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.157502] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.157718] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.157877] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.158035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.158092] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.158243] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.158329] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.158419] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.180823] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.182378] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.182378] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.182590] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 85fbe51b-2508-45d1-a3e3-b6c38fac2060 with status ACTIVE [ 909.186907] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.186907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.186907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.186907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.186907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.186907] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.186907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.186907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.186907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.186907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.186907] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.186907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.186907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.186907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.186907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.186907] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 85fbe51b-2508-45d1-a3e3-b6c38fac2060 is going to be updated. [ 909.220255] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.220400] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.220465] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.220673] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.220797] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.220953] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85fbe51b-2508-45d1-a3e3-b6c38fac2060" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.662046] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.687108] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.166450] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.189821] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.189981] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.190178] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.190445] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.190445] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.190445] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 is going to be created. [ 910.220392] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.220546] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.220615] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.221191] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.221191] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.233517] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: UNINITIALIZED for 2s [ 910.299086] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca99b1a6-3702-4011-942b-06036fda2165 in Status: SUCCESS [ 910.299274] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca99b1a6-3702-4011-942b-06036fda2165 deletion is rescheduled due to dependency. [ 910.299388] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.670209] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.670467] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.670540] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.670768] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.670861] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.671313] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 is going to be updated. [ 910.707651] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.707651] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.707835] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.707991] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.708115] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.721827] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 in Status: IN_PROGRESS for 2s [ 910.783167] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbc55d75-4ce5-409b-958a-48efef735829 in Status: SUCCESS [ 910.783167] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.046081] env[65783]: INFO networking_nsxv3.common.synchronization [req-38f99148-ea4a-4913-a541-7e2d152a9c68 req-516d16d3-44e1-4918-bdf0-3feb7f3abeb3 tempest-ServerActionsTestOtherB-29394606 tempest-ServerActionsTestOtherB-29394606-project-member] Enqueued Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_members [ 912.046840] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_members [ 912.049352] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c81f8cb-609b-4496-9f07-b80abbe519f8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.049623] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.050472] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.050472] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.050472] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.050712] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.050869] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.051139] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.051279] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.051466] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.243800] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: UNINITIALIZED for 4s [ 912.555059] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.555302] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.555418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.555754] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.556121] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.556121] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.556297] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.556297] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.556409] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.556483] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.556571] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 is going to be updated. [ 912.586609] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.586836] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.586836] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.587140] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.587793] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.599341] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: IN_PROGRESS for 2s [ 912.732207] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-702 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.732207] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-702" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.732207] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-702" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.732207] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-702" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.732207] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.732207] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.732207] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.732207] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.733109] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.734082] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 912.734455] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 912.734936] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 912.735335] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 912.736996] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 912.736996] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 912.737846] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 912.739805] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 in Status: SUCCESS [ 912.739805] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.761962] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 912.762161] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 912.762383] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 912.762570] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-702" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.762895] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-e98f1b15-0a05-4be4-b950-dd7e6749eb8f taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.763086] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-e98f1b15-0a05-4be4-b950-dd7e6749eb8f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.763347] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-e98f1b15-0a05-4be4-b950-dd7e6749eb8f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.764424] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-e98f1b15-0a05-4be4-b950-dd7e6749eb8f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.764614] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e98f1b15-0a05-4be4-b950-dd7e6749eb8f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.942802] env[65783]: INFO networking_nsxv3.common.synchronization [None req-e938e655-9390-4bd5-b1e0-7c62abcf3516 None None] Enqueued Resource ID: 0f8d0eb2-e863-4d91-b2c5-7fcfc5324cbd with Priority: HIGHEST for action port [ 912.943384] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f8d0eb2-e863-4d91-b2c5-7fcfc5324cbd with Priority: HIGHEST for action port [ 912.943724] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f8d0eb2-e863-4d91-b2c5-7fcfc5324cbd taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.944426] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f8d0eb2-e863-4d91-b2c5-7fcfc5324cbd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.944516] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f8d0eb2-e863-4d91-b2c5-7fcfc5324cbd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.944900] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f8d0eb2-e863-4d91-b2c5-7fcfc5324cbd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.944991] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f8d0eb2-e863-4d91-b2c5-7fcfc5324cbd',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.267789] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.268121] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.268121] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.268436] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.268615] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.268809] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port e98f1b15-0a05-4be4-b950-dd7e6749eb8f not found, creating... [ 913.269225] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.269366] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.269493] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.269798] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.269905] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.270234] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.274198] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.274198] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.274198] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.274198] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.274198] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: e98f1b15-0a05-4be4-b950-dd7e6749eb8f is going to be created. [ 913.310415] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.310415] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.310415] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.310415] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.310415] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.310415] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-e98f1b15-0a05-4be4-b950-dd7e6749eb8f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.448117] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f8d0eb2-e863-4d91-b2c5-7fcfc5324cbd [ 913.448117] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.448117] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.448117] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.448117] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.448117] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.448117] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f8d0eb2-e863-4d91-b2c5-7fcfc5324cbd already deleted. [ 913.448117] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f8d0eb2-e863-4d91-b2c5-7fcfc5324cbd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.488575] env[65783]: INFO networking_nsxv3.common.synchronization [None req-5a9a06df-3dde-404a-903d-e914cf701cfd None None] Enqueued Resource ID: ebb724ad-6c10-4f75-b6d1-ec07c2a14cf8 with Priority: HIGHEST for action port [ 913.488575] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb724ad-6c10-4f75-b6d1-ec07c2a14cf8 with Priority: HIGHEST for action port [ 913.488575] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebb724ad-6c10-4f75-b6d1-ec07c2a14cf8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.488575] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebb724ad-6c10-4f75-b6d1-ec07c2a14cf8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.488859] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebb724ad-6c10-4f75-b6d1-ec07c2a14cf8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.489320] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebb724ad-6c10-4f75-b6d1-ec07c2a14cf8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.489704] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebb724ad-6c10-4f75-b6d1-ec07c2a14cf8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.994259] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ebb724ad-6c10-4f75-b6d1-ec07c2a14cf8 [ 913.996453] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.996453] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.996453] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.996453] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.996453] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.996453] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ebb724ad-6c10-4f75-b6d1-ec07c2a14cf8 already deleted. [ 913.996828] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebb724ad-6c10-4f75-b6d1-ec07c2a14cf8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.119286] env[65783]: INFO networking_nsxv3.common.synchronization [req-38f99148-ea4a-4913-a541-7e2d152a9c68 req-6ba5c447-6891-4376-b326-bb0a49c9c7c5 service nova] Enqueued Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_rules [ 914.119486] env[65783]: INFO networking_nsxv3.common.synchronization [req-38f99148-ea4a-4913-a541-7e2d152a9c68 req-6ba5c447-6891-4376-b326-bb0a49c9c7c5 service nova] Enqueued Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_members [ 914.119622] env[65783]: INFO networking_nsxv3.common.synchronization [req-38f99148-ea4a-4913-a541-7e2d152a9c68 req-6ba5c447-6891-4376-b326-bb0a49c9c7c5 service nova] Enqueued Resource ID: e98f1b15-0a05-4be4-b950-dd7e6749eb8f with Priority: HIGHEST for action port [ 914.120457] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_rules [ 914.120457] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_members [ 914.120457] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e98f1b15-0a05-4be4-b950-dd7e6749eb8f with Priority: HIGHEST for action port [ 914.120797] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c81f8cb-609b-4496-9f07-b80abbe519f8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.120885] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.120936] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.121691] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.121691] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.122570] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c81f8cb-609b-4496-9f07-b80abbe519f8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.122829] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.122917] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-e98f1b15-0a05-4be4-b950-dd7e6749eb8f taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.123046] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e98f1b15-0a05-4be4-b950-dd7e6749eb8f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.123120] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e98f1b15-0a05-4be4-b950-dd7e6749eb8f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.124446] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e98f1b15-0a05-4be4-b950-dd7e6749eb8f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.124446] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e98f1b15-0a05-4be4-b950-dd7e6749eb8f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.156677] env[65783]: INFO networking_nsxv3.common.synchronization [req-5f273e50-9693-4e3d-992e-f6227f33ad85 req-27b6d745-7c6d-4d92-a2ad-087b49d64546 tempest-ImagesTestJSON-433702528 tempest-ImagesTestJSON-433702528-project-member] Enqueued Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 914.158043] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 914.158616] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.158783] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.158860] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.159078] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.159238] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.159406] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.159732] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.159942] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.161028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.161028] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.258025] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: SUCCESS [ 914.258025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.258025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.258025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.258025] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.258025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.258025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.259013] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.259430] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.259800] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.260228] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.565861] env[65783]: INFO networking_nsxv3.common.synchronization [req-8c9df665-2599-4e4b-aefd-ff617e148e8d req-aac4ccde-0e98-499d-87b8-34b8ee4175eb tempest-ServerDiskConfigTestJSON-664757069 tempest-ServerDiskConfigTestJSON-664757069-project-member] Enqueued Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 914.568651] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 914.568926] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.569062] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.569127] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.569338] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.569487] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.569582] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.569644] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.570056] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.570056] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.570056] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.612647] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: SUCCESS [ 914.612647] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 deletion is rescheduled due to dependency. [ 914.612647] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.612647] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.612647] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.612647] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.612647] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.612647] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.612647] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.612647] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.612647] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.627271] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c81f8cb-609b-4496-9f07-b80abbe519f8 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.627271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.627271] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e98f1b15-0a05-4be4-b950-dd7e6749eb8f with status ACTIVE [ 914.627271] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.627271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.627271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.627271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.627271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.627271] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.627271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.627271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.627271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.627271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.627271] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.627932] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.627932] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.627932] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.627932] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.627932] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e98f1b15-0a05-4be4-b950-dd7e6749eb8f is going to be updated. [ 914.650507] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.650507] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.650507] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.651454] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.651454] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.651454] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e98f1b15-0a05-4be4-b950-dd7e6749eb8f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.663310] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.763398] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.763628] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.763709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.763931] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.764144] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.764253] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.764313] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.764454] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.764544] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.764680] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.764808] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.764899] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.764955] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.765119] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.765254] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.765424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.765424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.765615] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.765615] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.765737] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.765767] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.018856] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-965 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.019151] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-965" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.019348] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-965" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.019559] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-965" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.019821] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.019979] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.020165] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.020390] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.020533] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.020733] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 915.020843] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 915.020948] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 915.021065] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 915.021171] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 915.021274] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 915.021401] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 915.040045] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 915.040384] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 915.040600] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 915.040799] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-965" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.041167] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-cd2184dd-c826-412e-a259-8e9ebb22c2e5 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.041417] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-cd2184dd-c826-412e-a259-8e9ebb22c2e5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.041576] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-cd2184dd-c826-412e-a259-8e9ebb22c2e5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.041920] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-cd2184dd-c826-412e-a259-8e9ebb22c2e5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.042080] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd2184dd-c826-412e-a259-8e9ebb22c2e5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.058962] env[65783]: INFO networking_nsxv3.common.synchronization [None req-00fb1c11-f17c-48eb-b86f-e7d0d124a302 None None] Enqueued Resource ID: 94a30ac0-f430-40f6-a563-870aabbc7b43 with Priority: HIGHEST for action port [ 915.059844] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94a30ac0-f430-40f6-a563-870aabbc7b43 with Priority: HIGHEST for action port [ 915.060636] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-94a30ac0-f430-40f6-a563-870aabbc7b43 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.060636] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94a30ac0-f430-40f6-a563-870aabbc7b43" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.060636] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94a30ac0-f430-40f6-a563-870aabbc7b43" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.060810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94a30ac0-f430-40f6-a563-870aabbc7b43" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.060810] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94a30ac0-f430-40f6-a563-870aabbc7b43',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.073031] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.073031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.073031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.073031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.073031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.073312] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.073312] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.073312] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.073432] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.073512] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.073593] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 is going to be updated. [ 915.100100] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.100308] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.100308] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.100534] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.100668] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.111052] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: IN_PROGRESS for 2s [ 915.114528] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.166615] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.268025] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6: rpc.has_security_group_logging(os_id): False [ 915.407311] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.407311] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.407311] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.407534] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.407534] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.407738] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.407883] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.408029] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.408132] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.408207] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.408411] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.408531] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.408624] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.408813] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.408900] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.409894] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.410047] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.410136] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.410388] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.410447] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.410549] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 is going to be created. [ 915.487865] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.488079] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.488186] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.488431] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.488624] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.508826] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: IN_PROGRESS for 2s [ 915.545400] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.545924] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.546136] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.546428] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.546602] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.546762] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port cd2184dd-c826-412e-a259-8e9ebb22c2e5 not found, creating... [ 915.547166] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.547452] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.547631] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.547954] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.549052] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.549502] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.549865] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.550072] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.551442] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.551442] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.551864] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: cd2184dd-c826-412e-a259-8e9ebb22c2e5 is going to be created. [ 915.563173] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94a30ac0-f430-40f6-a563-870aabbc7b43 [ 915.563479] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.563623] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.563690] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.563905] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.563976] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.564103] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94a30ac0-f430-40f6-a563-870aabbc7b43 already deleted. [ 915.564185] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94a30ac0-f430-40f6-a563-870aabbc7b43" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.577248] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.577577] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.577577] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.577696] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.577924] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.578272] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-cd2184dd-c826-412e-a259-8e9ebb22c2e5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.617937] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.668928] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.669203] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.669203] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.669402] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.669485] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.669589] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd942bf-b305-4707-8084-1ac6b135c741 is going to be updated. [ 915.723402] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.723827] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.723923] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.724227] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.724424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.742089] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: IN_PROGRESS for 2s [ 915.826316] env[65783]: INFO networking_nsxv3.common.synchronization [None req-6ed8b727-33a3-4f8d-8134-d411f7fe2526 None None] Enqueued Resource ID: ce351dd8-2a02-4390-9fa1-ec5f63579ef4 with Priority: HIGHEST for action port [ 915.826316] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce351dd8-2a02-4390-9fa1-ec5f63579ef4 with Priority: HIGHEST for action port [ 915.826481] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce351dd8-2a02-4390-9fa1-ec5f63579ef4 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.826649] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce351dd8-2a02-4390-9fa1-ec5f63579ef4" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.826684] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce351dd8-2a02-4390-9fa1-ec5f63579ef4" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.826925] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce351dd8-2a02-4390-9fa1-ec5f63579ef4" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.827012] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce351dd8-2a02-4390-9fa1-ec5f63579ef4',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.120169] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.120402] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.120480] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.120685] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.120776] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.120872] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 is going to be updated. [ 916.151267] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.151267] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.151267] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.151267] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.151267] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.163194] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: IN_PROGRESS for 2s [ 916.322187] env[65783]: INFO networking_nsxv3.common.synchronization [req-8c9df665-2599-4e4b-aefd-ff617e148e8d req-8e69d10e-9123-4912-a3ac-2330f85da6d3 service nova] Enqueued Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_rules [ 916.322411] env[65783]: INFO networking_nsxv3.common.synchronization [req-8c9df665-2599-4e4b-aefd-ff617e148e8d req-8e69d10e-9123-4912-a3ac-2330f85da6d3 service nova] Enqueued Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 916.322557] env[65783]: INFO networking_nsxv3.common.synchronization [req-8c9df665-2599-4e4b-aefd-ff617e148e8d req-8e69d10e-9123-4912-a3ac-2330f85da6d3 service nova] Enqueued Resource ID: cd2184dd-c826-412e-a259-8e9ebb22c2e5 with Priority: HIGHEST for action port [ 916.323238] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_rules [ 916.323393] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 916.323529] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd2184dd-c826-412e-a259-8e9ebb22c2e5 with Priority: HIGHEST for action port [ 916.323762] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.323917] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.323957] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.324158] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.324240] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.325357] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.325357] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.325493] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd2184dd-c826-412e-a259-8e9ebb22c2e5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.325634] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd2184dd-c826-412e-a259-8e9ebb22c2e5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.325634] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd2184dd-c826-412e-a259-8e9ebb22c2e5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.326115] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd2184dd-c826-412e-a259-8e9ebb22c2e5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.326115] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd2184dd-c826-412e-a259-8e9ebb22c2e5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.329316] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ce351dd8-2a02-4390-9fa1-ec5f63579ef4 [ 916.329509] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.329626] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.329693] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.329882] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.329966] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.330079] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ce351dd8-2a02-4390-9fa1-ec5f63579ef4 already deleted. [ 916.330156] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce351dd8-2a02-4390-9fa1-ec5f63579ef4" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.717581] env[65783]: INFO networking_nsxv3.common.synchronization [None req-f1e11f9e-3c8d-41cc-8d37-fada95170383 tempest-AttachVolumeShelveTestJSON-903356803 tempest-AttachVolumeShelveTestJSON-903356803-project-member] Enqueued Resource ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b with Priority: HIGHEST for action security_group_rules [ 916.718205] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b with Priority: HIGHEST for action security_group_rules [ 916.718561] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdcea21f-f135-4ab1-9f28-d5be76c7c16b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.718644] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.718806] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.718940] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.719044] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdcea21f-f135-4ab1-9f28-d5be76c7c16b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.827387] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.827854] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.827854] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cd2184dd-c826-412e-a259-8e9ebb22c2e5 with status ACTIVE [ 916.827854] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.828016] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.828016] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.828227] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.828315] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.828490] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.828583] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.828644] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.829106] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.829106] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.829106] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.829315] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.829315] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.829315] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.829397] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.829461] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cd2184dd-c826-412e-a259-8e9ebb22c2e5 is going to be updated. [ 916.837197] env[65783]: INFO networking_nsxv3.common.synchronization [None req-800a3309-de0d-4a15-9ca8-492abc249804 tempest-AttachVolumeShelveTestJSON-903356803 tempest-AttachVolumeShelveTestJSON-903356803-project-member] Enqueued Resource ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b with Priority: HIGHEST for action security_group_rules [ 916.838640] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b with Priority: HIGHEST for action security_group_rules [ 916.838640] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdcea21f-f135-4ab1-9f28-d5be76c7c16b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.838640] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.856106] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.856106] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.856106] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.856106] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.856106] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.856354] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd2184dd-c826-412e-a259-8e9ebb22c2e5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.123243] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: SUCCESS [ 917.123415] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 deletion is rescheduled due to dependency. [ 917.123457] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.125922] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.125922] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.125922] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.125922] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.125922] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.125922] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.125922] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.125922] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.241981] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.242421] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.242421] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.242641] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.242732] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.242858] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b already deleted. [ 917.242947] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.243121] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.243282] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.243425] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdcea21f-f135-4ab1-9f28-d5be76c7c16b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.523343] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: SUCCESS [ 917.523343] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.561500] env[65783]: INFO networking_nsxv3.common.synchronization [None req-41d6040c-e3b9-4d8a-bc4f-4a7a6b661b51 tempest-ImagesOneServerNegativeTestJSON-1524253690 tempest-ImagesOneServerNegativeTestJSON-1524253690-project-member] Enqueued Resource ID: db7706f5-d9ed-4f42-b371-2f4b8a8ef1d4 with Priority: HIGHEST for action security_group_rules [ 917.562182] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db7706f5-d9ed-4f42-b371-2f4b8a8ef1d4 with Priority: HIGHEST for action security_group_rules [ 917.563708] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db7706f5-d9ed-4f42-b371-2f4b8a8ef1d4 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.563865] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db7706f5-d9ed-4f42-b371-2f4b8a8ef1d4" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.563937] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db7706f5-d9ed-4f42-b371-2f4b8a8ef1d4" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.565535] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db7706f5-d9ed-4f42-b371-2f4b8a8ef1d4" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.565672] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db7706f5-d9ed-4f42-b371-2f4b8a8ef1d4',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.626960] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.667611] env[65783]: INFO networking_nsxv3.common.synchronization [None req-6075d56f-0d6f-45c3-aa5d-407df26444d7 tempest-ImagesOneServerNegativeTestJSON-1524253690 tempest-ImagesOneServerNegativeTestJSON-1524253690-project-member] Enqueued Resource ID: db7706f5-d9ed-4f42-b371-2f4b8a8ef1d4 with Priority: HIGHEST for action security_group_rules [ 917.668650] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db7706f5-d9ed-4f42-b371-2f4b8a8ef1d4 with Priority: HIGHEST for action security_group_rules [ 917.668650] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db7706f5-d9ed-4f42-b371-2f4b8a8ef1d4 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.668650] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db7706f5-d9ed-4f42-b371-2f4b8a8ef1d4" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.755428] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: SUCCESS [ 917.755792] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.766347] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.766518] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.766632] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.766808] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.766893] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.766983] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b already deleted. [ 917.767075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.089949] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.090367] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.090542] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.090772] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.090863] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.090960] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db7706f5-d9ed-4f42-b371-2f4b8a8ef1d4 already deleted. [ 918.091059] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db7706f5-d9ed-4f42-b371-2f4b8a8ef1d4" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.091704] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db7706f5-d9ed-4f42-b371-2f4b8a8ef1d4" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.091805] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db7706f5-d9ed-4f42-b371-2f4b8a8ef1d4" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.092045] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db7706f5-d9ed-4f42-b371-2f4b8a8ef1d4',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.130112] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.176433] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: SUCCESS [ 918.179037] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.179037] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.179037] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.179037] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.179037] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.179037] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.179037] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.179037] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.179037] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.179037] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.624556] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.624770] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.624770] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.624997] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.625106] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.625207] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db7706f5-d9ed-4f42-b371-2f4b8a8ef1d4 already deleted. [ 918.625344] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db7706f5-d9ed-4f42-b371-2f4b8a8ef1d4" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.633040] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.633207] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.633276] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.633572] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.633662] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.633762] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 is going to be updated. [ 918.669415] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.669574] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.669636] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.669829] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.669970] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.679475] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: IN_PROGRESS for 2s [ 918.680857] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.183499] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c81f8cb-609b-4496-9f07-b80abbe519f8: rpc.has_security_group_logging(os_id): False [ 919.205909] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.206080] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.206155] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.206383] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.206494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.206856] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.206963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.207026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.207201] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.207280] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.207365] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 is going to be updated. [ 919.283748] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.283909] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.283946] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.284174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.284313] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.301020] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: IN_PROGRESS for 2s [ 920.692742] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: SUCCESS [ 920.693154] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.693321] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.693600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.693889] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.694048] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.694114] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.694285] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.694368] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.694455] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.694549] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.198131] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.198326] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.198395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.198616] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.198784] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.198901] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.198963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.199100] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.199183] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.199270] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.199735] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.199735] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.199735] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.199735] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.199967] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.199967] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.199967] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.200151] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.200151] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.200259] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.200327] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.314188] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: SUCCESS [ 921.314418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.704921] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9943d881-28bf-4885-906c-d360f9c2c3e7: rpc.has_security_group_logging(os_id): False [ 921.727230] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.727230] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.727230] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.727230] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.727230] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.727230] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.727230] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.727230] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.728041] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.728361] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.728869] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.729251] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.729548] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.729956] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.730368] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.730730] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.730993] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.731198] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.731469] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.731670] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.731847] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 is going to be updated. [ 921.805942] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.806117] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.806160] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.806378] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.806518] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.825106] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: IN_PROGRESS for 2s [ 922.668963] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 922.669122] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 923.055456] env[65783]: INFO networking_nsxv3.common.synchronization [None req-5f14f431-c884-4d23-884e-2d94401f73b3 None None] Enqueued Resource ID: 194500d6-37c3-4f8a-ab4e-81ebdad11d3a with Priority: HIGHEST for action port [ 923.055861] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194500d6-37c3-4f8a-ab4e-81ebdad11d3a with Priority: HIGHEST for action port [ 923.056304] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-194500d6-37c3-4f8a-ab4e-81ebdad11d3a taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.056435] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-194500d6-37c3-4f8a-ab4e-81ebdad11d3a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.056503] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-194500d6-37c3-4f8a-ab4e-81ebdad11d3a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.056840] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-194500d6-37c3-4f8a-ab4e-81ebdad11d3a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.056932] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('194500d6-37c3-4f8a-ab4e-81ebdad11d3a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.351297] env[65783]: INFO networking_nsxv3.common.synchronization [None req-51d4a9d4-2eaf-42ff-80d6-690341f3728e None None] Enqueued Resource ID: a038f555-d984-49f7-9508-01e755899f09 with Priority: HIGHEST for action port [ 923.351297] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a038f555-d984-49f7-9508-01e755899f09 with Priority: HIGHEST for action port [ 923.351297] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-a038f555-d984-49f7-9508-01e755899f09 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.351297] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a038f555-d984-49f7-9508-01e755899f09" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.351297] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a038f555-d984-49f7-9508-01e755899f09" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.351557] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a038f555-d984-49f7-9508-01e755899f09" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.351663] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a038f555-d984-49f7-9508-01e755899f09',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.559432] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 194500d6-37c3-4f8a-ab4e-81ebdad11d3a [ 923.563705] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.563705] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.563705] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.563705] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.563705] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.563705] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:194500d6-37c3-4f8a-ab4e-81ebdad11d3a already deleted. [ 923.563705] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-194500d6-37c3-4f8a-ab4e-81ebdad11d3a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.842018] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: SUCCESS [ 923.843158] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.854124] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a038f555-d984-49f7-9508-01e755899f09 [ 923.854124] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.854391] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.854495] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.854824] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.855904] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.855904] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a038f555-d984-49f7-9508-01e755899f09 already deleted. [ 923.855904] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a038f555-d984-49f7-9508-01e755899f09" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.906286] env[65783]: INFO networking_nsxv3.common.synchronization [req-bda08833-ff2e-446e-b0b6-1e144c1d5862 req-eae66427-45bf-4f33-bf1b-8a104feb33fe tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 with Priority: HIGHEST for action security_group_members [ 923.906464] env[65783]: INFO networking_nsxv3.common.synchronization [req-bda08833-ff2e-446e-b0b6-1e144c1d5862 req-eae66427-45bf-4f33-bf1b-8a104feb33fe tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_members [ 923.906990] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 with Priority: HIGHEST for action security_group_members [ 923.907143] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_members [ 923.907421] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.907542] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.907608] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.907865] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.908661] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.908817] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.908916] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.909117] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.909212] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.909312] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dccc2c0a-475d-4f38-ad2a-2e54cdca65b1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.910192] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.910306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.910391] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.910626] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.911275] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.911275] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.911275] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.911275] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.911548] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.911548] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.952745] env[65783]: INFO networking_nsxv3.common.synchronization [req-bda08833-ff2e-446e-b0b6-1e144c1d5862 req-eae66427-45bf-4f33-bf1b-8a104feb33fe tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_rules [ 923.952745] env[65783]: INFO networking_nsxv3.common.synchronization [req-bda08833-ff2e-446e-b0b6-1e144c1d5862 req-eae66427-45bf-4f33-bf1b-8a104feb33fe tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_members [ 923.952745] env[65783]: INFO networking_nsxv3.common.synchronization [req-bda08833-ff2e-446e-b0b6-1e144c1d5862 req-eae66427-45bf-4f33-bf1b-8a104feb33fe tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 with Priority: HIGHEST for action security_group_rules [ 923.952745] env[65783]: INFO networking_nsxv3.common.synchronization [req-bda08833-ff2e-446e-b0b6-1e144c1d5862 req-eae66427-45bf-4f33-bf1b-8a104feb33fe tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 with Priority: HIGHEST for action security_group_members [ 923.952745] env[65783]: INFO networking_nsxv3.common.synchronization [req-bda08833-ff2e-446e-b0b6-1e144c1d5862 req-eae66427-45bf-4f33-bf1b-8a104feb33fe tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: 85fbe51b-2508-45d1-a3e3-b6c38fac2060 with Priority: HIGHEST for action port [ 923.953731] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_rules [ 923.953731] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 with Priority: HIGHEST for action security_group_rules [ 923.953731] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85fbe51b-2508-45d1-a3e3-b6c38fac2060 with Priority: HIGHEST for action port [ 923.953731] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_members [ 923.953731] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 with Priority: HIGHEST for action security_group_members [ 923.954559] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.954559] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.954559] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.954559] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.954559] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.955240] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.955352] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.959128] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.959416] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.959531] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dccc2c0a-475d-4f38-ad2a-2e54cdca65b1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.960476] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-85fbe51b-2508-45d1-a3e3-b6c38fac2060 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.960608] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85fbe51b-2508-45d1-a3e3-b6c38fac2060" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.960680] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85fbe51b-2508-45d1-a3e3-b6c38fac2060" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.960819] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85fbe51b-2508-45d1-a3e3-b6c38fac2060" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.960892] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85fbe51b-2508-45d1-a3e3-b6c38fac2060',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.962065] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.962065] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.962277] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.962523] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.260607] env[65783]: INFO networking_nsxv3.common.synchronization [req-36fbed3c-de44-4f44-8f81-444266a9452d req-6352c4ff-54da-4ee5-845b-c35606268df6 tempest-DeleteServersTestJSON-1456685968 tempest-DeleteServersTestJSON-1456685968-project-member] Enqueued Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 924.261830] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 924.261830] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.261830] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.261830] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.262075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.262877] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.262989] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.263082] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.263261] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.265607] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.265762] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.413923] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dccc2c0a-475d-4f38-ad2a-2e54cdca65b1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.414948] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.463691] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 85fbe51b-2508-45d1-a3e3-b6c38fac2060 with status ACTIVE [ 924.465325] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.465540] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.465617] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.465846] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.465930] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.466157] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.466261] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.466320] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.466477] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.466635] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.466747] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.466834] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.466900] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.467046] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.467120] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.467200] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 85fbe51b-2508-45d1-a3e3-b6c38fac2060 is going to be updated. [ 924.468380] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.468472] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.468697] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.468778] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.493439] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.493577] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.493663] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.493858] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.493997] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.494165] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85fbe51b-2508-45d1-a3e3-b6c38fac2060" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.771545] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.771728] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.771765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.772350] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.772350] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.772350] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.772567] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.772567] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.772629] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.772658] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.772752] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 is going to be updated. [ 924.806820] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.807051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.807051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.807251] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.807386] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.820762] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: IN_PROGRESS for 2s [ 924.919420] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dccc2c0a-475d-4f38-ad2a-2e54cdca65b1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.920456] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.066543] env[65783]: INFO networking_nsxv3.common.synchronization [None req-93cad0e9-b94a-40f7-9e90-59a8ced1c143 tempest-AttachVolumeNegativeTest-1814624860 tempest-AttachVolumeNegativeTest-1814624860-project-member] Enqueued Resource ID: 21a0bbd4-6f51-4a42-b423-363e65f0247c with Priority: HIGHEST for action security_group_rules [ 925.067453] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21a0bbd4-6f51-4a42-b423-363e65f0247c with Priority: HIGHEST for action security_group_rules [ 925.067453] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21a0bbd4-6f51-4a42-b423-363e65f0247c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.067453] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.067453] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.068101] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.068101] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21a0bbd4-6f51-4a42-b423-363e65f0247c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.329060] env[65783]: INFO networking_nsxv3.common.synchronization [req-37b1c265-93ef-450f-830d-ceb25302973d req-6164e468-c6c3-4d83-9a01-187796deb313 tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 with Priority: HIGHEST for action security_group_members [ 925.329567] env[65783]: INFO networking_nsxv3.common.synchronization [req-37b1c265-93ef-450f-830d-ceb25302973d req-6164e468-c6c3-4d83-9a01-187796deb313 tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: 9b8bb0e6-1d22-4e95-a649-fc4d3180195b with Priority: HIGHEST for action security_group_members [ 925.329567] env[65783]: INFO networking_nsxv3.common.synchronization [req-37b1c265-93ef-450f-830d-ceb25302973d req-6164e468-c6c3-4d83-9a01-187796deb313 tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_members [ 925.331048] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 with Priority: HIGHEST for action security_group_members [ 925.333446] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b8bb0e6-1d22-4e95-a649-fc4d3180195b with Priority: HIGHEST for action security_group_members [ 925.333446] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_members [ 925.333446] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.333646] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.334098] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b8bb0e6-1d22-4e95-a649-fc4d3180195b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.334098] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b8bb0e6-1d22-4e95-a649-fc4d3180195b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.335308] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b8bb0e6-1d22-4e95-a649-fc4d3180195b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.335977] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b8bb0e6-1d22-4e95-a649-fc4d3180195b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.335977] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.336984] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.336984] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.336984] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.336984] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.336984] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b8bb0e6-1d22-4e95-a649-fc4d3180195b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.338475] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.338666] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.392023] env[65783]: INFO networking_nsxv3.common.synchronization [req-37b1c265-93ef-450f-830d-ceb25302973d req-6164e468-c6c3-4d83-9a01-187796deb313 tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: 9b8bb0e6-1d22-4e95-a649-fc4d3180195b with Priority: HIGHEST for action security_group_rules [ 925.392575] env[65783]: INFO networking_nsxv3.common.synchronization [req-37b1c265-93ef-450f-830d-ceb25302973d req-6164e468-c6c3-4d83-9a01-187796deb313 tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: 9b8bb0e6-1d22-4e95-a649-fc4d3180195b with Priority: HIGHEST for action security_group_members [ 925.392770] env[65783]: INFO networking_nsxv3.common.synchronization [req-37b1c265-93ef-450f-830d-ceb25302973d req-6164e468-c6c3-4d83-9a01-187796deb313 tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_rules [ 925.392959] env[65783]: INFO networking_nsxv3.common.synchronization [req-37b1c265-93ef-450f-830d-ceb25302973d req-6164e468-c6c3-4d83-9a01-187796deb313 tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_members [ 925.393097] env[65783]: INFO networking_nsxv3.common.synchronization [req-37b1c265-93ef-450f-830d-ceb25302973d req-6164e468-c6c3-4d83-9a01-187796deb313 tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 with Priority: HIGHEST for action security_group_rules [ 925.393296] env[65783]: INFO networking_nsxv3.common.synchronization [req-37b1c265-93ef-450f-830d-ceb25302973d req-6164e468-c6c3-4d83-9a01-187796deb313 tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 with Priority: HIGHEST for action security_group_members [ 925.393501] env[65783]: INFO networking_nsxv3.common.synchronization [req-37b1c265-93ef-450f-830d-ceb25302973d req-6164e468-c6c3-4d83-9a01-187796deb313 tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: 85fbe51b-2508-45d1-a3e3-b6c38fac2060 with Priority: HIGHEST for action port [ 925.394143] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b8bb0e6-1d22-4e95-a649-fc4d3180195b with Priority: HIGHEST for action security_group_rules [ 925.394530] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_rules [ 925.394530] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 with Priority: HIGHEST for action security_group_members [ 925.394530] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85fbe51b-2508-45d1-a3e3-b6c38fac2060 with Priority: HIGHEST for action port [ 925.395198] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 with Priority: HIGHEST for action security_group_rules [ 925.395396] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b8bb0e6-1d22-4e95-a649-fc4d3180195b with Priority: HIGHEST for action security_group_members [ 925.395472] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_members [ 925.395796] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b8bb0e6-1d22-4e95-a649-fc4d3180195b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.395930] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b8bb0e6-1d22-4e95-a649-fc4d3180195b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.396023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b8bb0e6-1d22-4e95-a649-fc4d3180195b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.396329] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b8bb0e6-1d22-4e95-a649-fc4d3180195b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.396429] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b8bb0e6-1d22-4e95-a649-fc4d3180195b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.401451] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.403558] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.403775] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.404083] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.404153] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-85fbe51b-2508-45d1-a3e3-b6c38fac2060 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.404556] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85fbe51b-2508-45d1-a3e3-b6c38fac2060" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.404659] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85fbe51b-2508-45d1-a3e3-b6c38fac2060" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.404908] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85fbe51b-2508-45d1-a3e3-b6c38fac2060" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.404983] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85fbe51b-2508-45d1-a3e3-b6c38fac2060',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.406306] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.406469] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.408341] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b8bb0e6-1d22-4e95-a649-fc4d3180195b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.408341] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b8bb0e6-1d22-4e95-a649-fc4d3180195b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.408341] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.408341] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.423758] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.423758] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.423758] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.423758] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.423758] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.423758] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 is going to be created. [ 925.425271] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.425271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.425271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.425545] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.425596] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.425745] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 is going to be updated. [ 925.463761] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.463994] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.464080] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.464338] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.464596] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.470373] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.470622] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.470753] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.471751] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.471751] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.489285] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 in Status: UNINITIALIZED for 2s [ 925.490192] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: IN_PROGRESS for 2s [ 925.594701] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.595048] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.595048] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.595213] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.595303] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.595399] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21a0bbd4-6f51-4a42-b423-363e65f0247c already deleted. [ 925.595485] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.597687] env[65783]: INFO networking_nsxv3.common.synchronization [None req-0d8ad02c-6e10-49ed-aa70-a58ba2283005 tempest-AttachVolumeNegativeTest-1814624860 tempest-AttachVolumeNegativeTest-1814624860-project-member] Enqueued Resource ID: 21a0bbd4-6f51-4a42-b423-363e65f0247c with Priority: HIGHEST for action security_group_rules [ 925.598135] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21a0bbd4-6f51-4a42-b423-363e65f0247c with Priority: HIGHEST for action security_group_rules [ 925.599722] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21a0bbd4-6f51-4a42-b423-363e65f0247c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.599722] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.599722] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.599722] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.599722] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21a0bbd4-6f51-4a42-b423-363e65f0247c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.816222] env[65783]: INFO networking_nsxv3.common.synchronization [None req-f0524317-89a2-44a9-94dc-870add16437b None None] Enqueued Resource ID: f30b01ba-e1bc-4b49-9e11-cde4b0b7bafd with Priority: HIGHEST for action port [ 925.816823] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f30b01ba-e1bc-4b49-9e11-cde4b0b7bafd with Priority: HIGHEST for action port [ 925.817906] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-f30b01ba-e1bc-4b49-9e11-cde4b0b7bafd taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.818106] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f30b01ba-e1bc-4b49-9e11-cde4b0b7bafd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.818106] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f30b01ba-e1bc-4b49-9e11-cde4b0b7bafd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.818809] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f30b01ba-e1bc-4b49-9e11-cde4b0b7bafd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.818904] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f30b01ba-e1bc-4b49-9e11-cde4b0b7bafd',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.839574] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b8bb0e6-1d22-4e95-a649-fc4d3180195b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.901608] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b8bb0e6-1d22-4e95-a649-fc4d3180195b taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.902263] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b8bb0e6-1d22-4e95-a649-fc4d3180195b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.908566] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 85fbe51b-2508-45d1-a3e3-b6c38fac2060 with status ACTIVE [ 925.909856] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.910094] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.910094] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.911526] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.911526] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.911526] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.911526] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.911526] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.911526] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.911526] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.911526] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.911526] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.911526] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.913831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.913831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.913831] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 85fbe51b-2508-45d1-a3e3-b6c38fac2060 is going to be updated. [ 925.943038] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.943038] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.943038] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.943308] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.943445] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.943647] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85fbe51b-2508-45d1-a3e3-b6c38fac2060" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.189318] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.189318] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.189318] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.189318] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.189318] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.189318] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21a0bbd4-6f51-4a42-b423-363e65f0247c already deleted. [ 926.189318] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.321692] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f30b01ba-e1bc-4b49-9e11-cde4b0b7bafd [ 926.322047] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.322209] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.322285] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.322536] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.322630] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.322727] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f30b01ba-e1bc-4b49-9e11-cde4b0b7bafd already deleted. [ 926.322811] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f30b01ba-e1bc-4b49-9e11-cde4b0b7bafd" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.345512] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b8bb0e6-1d22-4e95-a649-fc4d3180195b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.830841] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: SUCCESS [ 926.831049] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 deletion is rescheduled due to dependency. [ 926.831173] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.848821] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.848972] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.849076] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.849279] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.849475] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.849475] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b8bb0e6-1d22-4e95-a649-fc4d3180195b is going to be created. [ 926.874279] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.874418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.874522] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.874700] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.874856] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.889646] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b8bb0e6-1d22-4e95-a649-fc4d3180195b in Status: UNINITIALIZED for 2s [ 927.500023] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 in Status: SUCCESS [ 927.500417] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.500458] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.500706] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.500933] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.501106] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.501232] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.501522] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.501522] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.501591] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dccc2c0a-475d-4f38-ad2a-2e54cdca65b1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.503258] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: SUCCESS [ 927.503532] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.503705] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.503907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.504124] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.504253] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.504322] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.504517] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.504615] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.504722] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.007859] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.009892] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dccc2c0a-475d-4f38-ad2a-2e54cdca65b1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.511201] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.513999] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dccc2c0a-475d-4f38-ad2a-2e54cdca65b1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.900184] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b8bb0e6-1d22-4e95-a649-fc4d3180195b in Status: SUCCESS [ 928.900691] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b8bb0e6-1d22-4e95-a649-fc4d3180195b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.900747] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b8bb0e6-1d22-4e95-a649-fc4d3180195b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.901043] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b8bb0e6-1d22-4e95-a649-fc4d3180195b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.901250] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.901401] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.901472] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.901811] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.901946] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.902051] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b8bb0e6-1d22-4e95-a649-fc4d3180195b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.017064] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.017064] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.017064] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.017064] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.017064] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.017064] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 is going to be updated. [ 929.017485] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.017485] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.017485] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.017485] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.017729] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.017729] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 is going to be updated. [ 929.050009] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.050167] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.050240] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.050453] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.050592] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.052328] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.052497] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.052870] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.053089] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.053740] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.064607] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: IN_PROGRESS for 2s [ 929.066171] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 in Status: IN_PROGRESS for 2s [ 929.405292] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b8bb0e6-1d22-4e95-a649-fc4d3180195b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.909302] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b8bb0e6-1d22-4e95-a649-fc4d3180195b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.414164] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.414164] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.414164] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.414164] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.414164] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.414164] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b8bb0e6-1d22-4e95-a649-fc4d3180195b is going to be updated. [ 930.454028] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.454028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.454028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.454028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.454028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.462563] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b8bb0e6-1d22-4e95-a649-fc4d3180195b in Status: IN_PROGRESS for 2s [ 930.818077] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 930.818245] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=12 [ 930.856707] env[65783]: INFO networking_nsxv3.common.synchronization [None req-d5f2e367-d869-4bc4-99e4-d944e66f2ffb None None] Enqueued Resource ID: 8f9fc27e-8410-491c-8f2b-b24691a833f1 with Priority: HIGHEST for action port [ 930.857291] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f9fc27e-8410-491c-8f2b-b24691a833f1 with Priority: HIGHEST for action port [ 930.857586] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f9fc27e-8410-491c-8f2b-b24691a833f1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.857702] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f9fc27e-8410-491c-8f2b-b24691a833f1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.857757] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f9fc27e-8410-491c-8f2b-b24691a833f1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.858020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f9fc27e-8410-491c-8f2b-b24691a833f1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.858799] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f9fc27e-8410-491c-8f2b-b24691a833f1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.078314] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: SUCCESS [ 931.078314] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.078604] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.078604] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.079096] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.079096] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.079096] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.079096] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.079335] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.079335] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.079335] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.082033] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 in Status: SUCCESS [ 931.082193] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.082370] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.082530] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.082730] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.082815] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.083136] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.083136] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.083136] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.083303] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.084243] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.084319] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.084434] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.084585] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.084585] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.084942] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.084942] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.084942] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.084942] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dccc2c0a-475d-4f38-ad2a-2e54cdca65b1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.087888] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.087888] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.087990] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.088051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.088371] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.088371] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.089244] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.089244] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dccc2c0a-475d-4f38-ad2a-2e54cdca65b1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.361692] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f9fc27e-8410-491c-8f2b-b24691a833f1 [ 931.361867] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.362059] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.362140] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.362449] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.362619] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.362702] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f9fc27e-8410-491c-8f2b-b24691a833f1 already deleted. [ 931.362770] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f9fc27e-8410-491c-8f2b-b24691a833f1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.439463] env[65783]: INFO networking_nsxv3.common.synchronization [req-68233dbf-ef32-4dff-9a20-265ba00e4b99 req-6cc4f7e7-01a6-41a9-94ac-aaff3352f08d tempest-ServerRescueTestJSONUnderV235-739854739 tempest-ServerRescueTestJSONUnderV235-739854739-project-member] Enqueued Resource ID: cbc55d75-4ce5-409b-958a-48efef735829 with Priority: HIGHEST for action security_group_members [ 931.439673] env[65783]: INFO networking_nsxv3.common.synchronization [req-68233dbf-ef32-4dff-9a20-265ba00e4b99 req-6cc4f7e7-01a6-41a9-94ac-aaff3352f08d tempest-ServerRescueTestJSONUnderV235-739854739 tempest-ServerRescueTestJSONUnderV235-739854739-project-member] Enqueued Resource ID: 9fcc697f-4055-405a-bcaa-722349f23210 with Priority: HIGHEST for action security_group_members [ 931.440876] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc55d75-4ce5-409b-958a-48efef735829 with Priority: HIGHEST for action security_group_members [ 931.441036] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fcc697f-4055-405a-bcaa-722349f23210 with Priority: HIGHEST for action security_group_members [ 931.441336] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc55d75-4ce5-409b-958a-48efef735829 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.441474] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.441518] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.441732] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.441893] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.441992] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.442067] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.442275] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.442365] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.442522] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbc55d75-4ce5-409b-958a-48efef735829',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.447176] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fcc697f-4055-405a-bcaa-722349f23210 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.447176] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fcc697f-4055-405a-bcaa-722349f23210" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.447176] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fcc697f-4055-405a-bcaa-722349f23210" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.447176] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fcc697f-4055-405a-bcaa-722349f23210" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.447176] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.447176] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.447176] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.447176] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.447176] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.447176] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fcc697f-4055-405a-bcaa-722349f23210',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.501813] env[65783]: INFO networking_nsxv3.common.synchronization [req-68233dbf-ef32-4dff-9a20-265ba00e4b99 req-6cc4f7e7-01a6-41a9-94ac-aaff3352f08d tempest-ServerRescueTestJSONUnderV235-739854739 tempest-ServerRescueTestJSONUnderV235-739854739-project-member] Enqueued Resource ID: 9fcc697f-4055-405a-bcaa-722349f23210 with Priority: HIGHEST for action security_group_rules [ 931.501813] env[65783]: INFO networking_nsxv3.common.synchronization [req-68233dbf-ef32-4dff-9a20-265ba00e4b99 req-6cc4f7e7-01a6-41a9-94ac-aaff3352f08d tempest-ServerRescueTestJSONUnderV235-739854739 tempest-ServerRescueTestJSONUnderV235-739854739-project-member] Enqueued Resource ID: 9fcc697f-4055-405a-bcaa-722349f23210 with Priority: HIGHEST for action security_group_members [ 931.501932] env[65783]: INFO networking_nsxv3.common.synchronization [req-68233dbf-ef32-4dff-9a20-265ba00e4b99 req-6cc4f7e7-01a6-41a9-94ac-aaff3352f08d tempest-ServerRescueTestJSONUnderV235-739854739 tempest-ServerRescueTestJSONUnderV235-739854739-project-member] Enqueued Resource ID: cbc55d75-4ce5-409b-958a-48efef735829 with Priority: HIGHEST for action security_group_rules [ 931.504173] env[65783]: INFO networking_nsxv3.common.synchronization [req-68233dbf-ef32-4dff-9a20-265ba00e4b99 req-6cc4f7e7-01a6-41a9-94ac-aaff3352f08d tempest-ServerRescueTestJSONUnderV235-739854739 tempest-ServerRescueTestJSONUnderV235-739854739-project-member] Enqueued Resource ID: cbc55d75-4ce5-409b-958a-48efef735829 with Priority: HIGHEST for action security_group_members [ 931.504173] env[65783]: INFO networking_nsxv3.common.synchronization [req-68233dbf-ef32-4dff-9a20-265ba00e4b99 req-6cc4f7e7-01a6-41a9-94ac-aaff3352f08d tempest-ServerRescueTestJSONUnderV235-739854739 tempest-ServerRescueTestJSONUnderV235-739854739-project-member] Enqueued Resource ID: 891ac553-14f8-41d2-a6e4-c24ef3c62c6a with Priority: HIGHEST for action port [ 931.504714] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fcc697f-4055-405a-bcaa-722349f23210 with Priority: HIGHEST for action security_group_rules [ 931.504714] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc55d75-4ce5-409b-958a-48efef735829 with Priority: HIGHEST for action security_group_rules [ 931.505490] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 891ac553-14f8-41d2-a6e4-c24ef3c62c6a with Priority: HIGHEST for action port [ 931.505490] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fcc697f-4055-405a-bcaa-722349f23210 with Priority: HIGHEST for action security_group_members [ 931.505490] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc55d75-4ce5-409b-958a-48efef735829 with Priority: HIGHEST for action security_group_members [ 931.505490] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9fcc697f-4055-405a-bcaa-722349f23210 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.505490] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9fcc697f-4055-405a-bcaa-722349f23210" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.505490] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9fcc697f-4055-405a-bcaa-722349f23210" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.506030] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9fcc697f-4055-405a-bcaa-722349f23210" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.506030] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9fcc697f-4055-405a-bcaa-722349f23210',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.506687] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbc55d75-4ce5-409b-958a-48efef735829 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.507403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.507403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.507403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.507403] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbc55d75-4ce5-409b-958a-48efef735829',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.509911] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-891ac553-14f8-41d2-a6e4-c24ef3c62c6a taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.510026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-891ac553-14f8-41d2-a6e4-c24ef3c62c6a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.510609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-891ac553-14f8-41d2-a6e4-c24ef3c62c6a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.510609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-891ac553-14f8-41d2-a6e4-c24ef3c62c6a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.510609] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('891ac553-14f8-41d2-a6e4-c24ef3c62c6a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.511064] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fcc697f-4055-405a-bcaa-722349f23210 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.511163] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fcc697f-4055-405a-bcaa-722349f23210" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.511349] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc55d75-4ce5-409b-958a-48efef735829 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.511433] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.589578] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.590682] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.590785] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.590961] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dccc2c0a-475d-4f38-ad2a-2e54cdca65b1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.591680] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dccc2c0a-475d-4f38-ad2a-2e54cdca65b1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.947692] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9fcc697f-4055-405a-bcaa-722349f23210',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.948658] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbc55d75-4ce5-409b-958a-48efef735829',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.015874] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fcc697f-4055-405a-bcaa-722349f23210 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.015995] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fcc697f-4055-405a-bcaa-722349f23210" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.016191] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 891ac553-14f8-41d2-a6e4-c24ef3c62c6a with status ACTIVE [ 932.016367] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.016474] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.016538] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.016741] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.017926] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.017926] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.017926] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.017926] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.017926] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.017926] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.017926] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.017926] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.017926] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.017926] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.017926] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.018322] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 891ac553-14f8-41d2-a6e4-c24ef3c62c6a is going to be updated. [ 932.021710] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc55d75-4ce5-409b-958a-48efef735829 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.021823] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.045760] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.045897] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.045964] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.046200] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.046330] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.046490] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-891ac553-14f8-41d2-a6e4-c24ef3c62c6a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.095667] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dccc2c0a-475d-4f38-ad2a-2e54cdca65b1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.096754] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.097549] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dccc2c0a-475d-4f38-ad2a-2e54cdca65b1: rpc.has_security_group_logging(os_id): False [ 932.130131] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.131048] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.131048] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.131048] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.131048] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.131048] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.131048] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.131777] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.131777] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.131777] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.131777] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 is going to be created. [ 932.216020] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.216218] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.216279] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.216464] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.219155] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.232730] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 in Status: IN_PROGRESS for 2s [ 932.353391] env[65783]: INFO networking_nsxv3.common.synchronization [None req-09b35b36-678b-4479-8d44-f6c8e6cbb6fb None None] Enqueued Resource ID: 5ee11661-6139-485a-979d-09a4e02ac455 with Priority: HIGHEST for action port [ 932.353391] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ee11661-6139-485a-979d-09a4e02ac455 with Priority: HIGHEST for action port [ 932.353391] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ee11661-6139-485a-979d-09a4e02ac455 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.353391] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ee11661-6139-485a-979d-09a4e02ac455" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.353391] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ee11661-6139-485a-979d-09a4e02ac455" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.353391] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ee11661-6139-485a-979d-09a4e02ac455" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.353391] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ee11661-6139-485a-979d-09a4e02ac455',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.449889] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9fcc697f-4055-405a-bcaa-722349f23210',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.451445] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbc55d75-4ce5-409b-958a-48efef735829',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.473100] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b8bb0e6-1d22-4e95-a649-fc4d3180195b in Status: SUCCESS [ 932.473316] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b8bb0e6-1d22-4e95-a649-fc4d3180195b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.473471] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b8bb0e6-1d22-4e95-a649-fc4d3180195b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.473814] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b8bb0e6-1d22-4e95-a649-fc4d3180195b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.474015] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.474129] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.474193] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.474575] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.474713] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.475054] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b8bb0e6-1d22-4e95-a649-fc4d3180195b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.475054] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b8bb0e6-1d22-4e95-a649-fc4d3180195b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.600671] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.600671] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.601892] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.602635] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.602635] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.602635] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 is going to be updated. [ 932.603800] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.603929] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.603998] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.604306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.604447] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.604578] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 is going to be updated. [ 932.639348] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.639606] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.639606] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.639786] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.639933] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.642043] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.642043] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.642309] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.642309] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.643407] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.655241] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: IN_PROGRESS for 2s [ 932.655241] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 in Status: IN_PROGRESS for 2s [ 932.857027] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ee11661-6139-485a-979d-09a4e02ac455 [ 932.857276] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.857428] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.857489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.857678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.857760] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.857928] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ee11661-6139-485a-979d-09a4e02ac455 already deleted. [ 932.857985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ee11661-6139-485a-979d-09a4e02ac455" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.956424] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.956424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.956424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.956424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.956424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.956424] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fcc697f-4055-405a-bcaa-722349f23210 is going to be created. [ 932.958372] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.958372] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.958372] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.958372] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.958372] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.958585] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbc55d75-4ce5-409b-958a-48efef735829 is going to be updated. [ 932.979043] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b8bb0e6-1d22-4e95-a649-fc4d3180195b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.991374] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.991374] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.991374] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.991374] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.991374] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.995862] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.995862] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.995862] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.995862] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.995862] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.009047] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc55d75-4ce5-409b-958a-48efef735829 in Status: IN_PROGRESS for 2s [ 933.010906] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fcc697f-4055-405a-bcaa-722349f23210 in Status: UNINITIALIZED for 2s [ 933.466529] env[65783]: INFO networking_nsxv3.common.synchronization [req-c021b56b-a185-464e-982b-0caecfd76711 req-93a11846-2ee6-4fe1-acde-067ca6b7b433 tempest-ServerRescueTestJSONUnderV235-739854739 tempest-ServerRescueTestJSONUnderV235-739854739-project-member] Enqueued Resource ID: cbc55d75-4ce5-409b-958a-48efef735829 with Priority: HIGHEST for action security_group_members [ 933.467125] env[65783]: INFO networking_nsxv3.common.synchronization [req-c021b56b-a185-464e-982b-0caecfd76711 req-93a11846-2ee6-4fe1-acde-067ca6b7b433 tempest-ServerRescueTestJSONUnderV235-739854739 tempest-ServerRescueTestJSONUnderV235-739854739-project-member] Enqueued Resource ID: 9fcc697f-4055-405a-bcaa-722349f23210 with Priority: HIGHEST for action security_group_members [ 933.467760] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc55d75-4ce5-409b-958a-48efef735829 with Priority: HIGHEST for action security_group_members [ 933.467930] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fcc697f-4055-405a-bcaa-722349f23210 with Priority: HIGHEST for action security_group_members [ 933.468253] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc55d75-4ce5-409b-958a-48efef735829 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.468350] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.468557] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fcc697f-4055-405a-bcaa-722349f23210 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.468643] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fcc697f-4055-405a-bcaa-722349f23210" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.482881] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b8bb0e6-1d22-4e95-a649-fc4d3180195b: rpc.has_security_group_logging(os_id): False [ 933.506664] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.507184] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.507184] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.507267] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.507917] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.507917] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.507917] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.507917] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.508190] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.508367] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.508367] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b8bb0e6-1d22-4e95-a649-fc4d3180195b is going to be created. [ 933.531102] env[65783]: INFO networking_nsxv3.common.synchronization [req-c021b56b-a185-464e-982b-0caecfd76711 req-93a11846-2ee6-4fe1-acde-067ca6b7b433 tempest-ServerRescueTestJSONUnderV235-739854739 tempest-ServerRescueTestJSONUnderV235-739854739-project-member] Enqueued Resource ID: cbc55d75-4ce5-409b-958a-48efef735829 with Priority: HIGHEST for action security_group_rules [ 933.531102] env[65783]: INFO networking_nsxv3.common.synchronization [req-c021b56b-a185-464e-982b-0caecfd76711 req-93a11846-2ee6-4fe1-acde-067ca6b7b433 tempest-ServerRescueTestJSONUnderV235-739854739 tempest-ServerRescueTestJSONUnderV235-739854739-project-member] Enqueued Resource ID: cbc55d75-4ce5-409b-958a-48efef735829 with Priority: HIGHEST for action security_group_members [ 933.531102] env[65783]: INFO networking_nsxv3.common.synchronization [req-c021b56b-a185-464e-982b-0caecfd76711 req-93a11846-2ee6-4fe1-acde-067ca6b7b433 tempest-ServerRescueTestJSONUnderV235-739854739 tempest-ServerRescueTestJSONUnderV235-739854739-project-member] Enqueued Resource ID: 891ac553-14f8-41d2-a6e4-c24ef3c62c6a with Priority: HIGHEST for action port [ 933.531944] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc55d75-4ce5-409b-958a-48efef735829 with Priority: HIGHEST for action security_group_rules [ 933.532600] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc55d75-4ce5-409b-958a-48efef735829 with Priority: HIGHEST for action security_group_members [ 933.532743] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 891ac553-14f8-41d2-a6e4-c24ef3c62c6a with Priority: HIGHEST for action port [ 933.533183] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbc55d75-4ce5-409b-958a-48efef735829 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.533554] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.533756] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc55d75-4ce5-409b-958a-48efef735829 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.533756] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.534024] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-891ac553-14f8-41d2-a6e4-c24ef3c62c6a taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.534173] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-891ac553-14f8-41d2-a6e4-c24ef3c62c6a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.534267] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-891ac553-14f8-41d2-a6e4-c24ef3c62c6a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.534516] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-891ac553-14f8-41d2-a6e4-c24ef3c62c6a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.534646] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('891ac553-14f8-41d2-a6e4-c24ef3c62c6a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.588620] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.589347] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.590651] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.590651] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.591490] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.621430] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b8bb0e6-1d22-4e95-a649-fc4d3180195b in Status: IN_PROGRESS for 2s [ 934.037604] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 891ac553-14f8-41d2-a6e4-c24ef3c62c6a with status ACTIVE [ 934.041075] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.041075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.041075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.041075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.041075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.041075] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.041075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.041075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.041075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.041075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.041075] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.041075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.041075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.041075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.041075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.041075] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 891ac553-14f8-41d2-a6e4-c24ef3c62c6a is going to be updated. [ 934.068015] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.069422] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.069422] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.069422] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.069422] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.069422] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-891ac553-14f8-41d2-a6e4-c24ef3c62c6a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.096279] env[65783]: INFO networking_nsxv3.common.synchronization [req-f8b01e04-50dd-4f8c-a192-6f3001e95dbb req-2d17b8a8-a0ed-4e23-aa6b-b8ced398f9e9 tempest-ServersTestMultiNic-291669374 tempest-ServersTestMultiNic-291669374-project-member] Enqueued Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 934.096279] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 934.096279] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.096279] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.096279] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.096592] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.096674] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.096767] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.096841] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.097179] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.097294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.097388] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.246923] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 in Status: SUCCESS [ 934.247211] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.247476] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.247589] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.247694] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dccc2c0a-475d-4f38-ad2a-2e54cdca65b1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.550793] env[65783]: INFO networking_nsxv3.common.synchronization [None req-f2b26c02-c50d-4223-b88c-a4e6f27960da None None] Enqueued Resource ID: 90e9a556-7bfa-416d-85c3-602fc0d01308 with Priority: HIGHEST for action port [ 934.552062] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90e9a556-7bfa-416d-85c3-602fc0d01308 with Priority: HIGHEST for action port [ 934.552495] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-90e9a556-7bfa-416d-85c3-602fc0d01308 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.552655] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90e9a556-7bfa-416d-85c3-602fc0d01308" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.552702] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90e9a556-7bfa-416d-85c3-602fc0d01308" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.552990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90e9a556-7bfa-416d-85c3-602fc0d01308" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.553098] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90e9a556-7bfa-416d-85c3-602fc0d01308',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.600491] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.600678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.600678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.600906] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.600994] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.601202] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.601306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.601546] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.601546] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.601706] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.601706] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 already deleted. [ 934.601798] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.662799] env[65783]: INFO networking_nsxv3.common.synchronization [req-f8b01e04-50dd-4f8c-a192-6f3001e95dbb req-120b8b31-d899-4939-933c-93bb0e1a87c8 tempest-ServersTestMultiNic-291669374 tempest-ServersTestMultiNic-291669374-project-member] Enqueued Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 934.663464] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 934.663731] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.663854] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.663939] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.664206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.664366] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.664468] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.664534] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.664684] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.664864] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.664864] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.666654] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: SUCCESS [ 934.666847] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.669036] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 in Status: SUCCESS [ 934.669036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.669036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.669193] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.669395] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.669475] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.669508] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.669662] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.669739] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.669829] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.671591] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.671760] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.671916] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.672055] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.672123] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.672261] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.672332] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.672421] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dccc2c0a-475d-4f38-ad2a-2e54cdca65b1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.699664] env[65783]: INFO networking_nsxv3.common.synchronization [None req-15c2096d-b9b8-49aa-a55f-39032409ad5c None None] Enqueued Resource ID: b6482cb8-f6ac-4094-8aa0-a05694f0e9a9 with Priority: HIGHEST for action port [ 934.701170] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6482cb8-f6ac-4094-8aa0-a05694f0e9a9 with Priority: HIGHEST for action port [ 934.701448] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6482cb8-f6ac-4094-8aa0-a05694f0e9a9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.701745] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6482cb8-f6ac-4094-8aa0-a05694f0e9a9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.701893] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6482cb8-f6ac-4094-8aa0-a05694f0e9a9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.702327] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6482cb8-f6ac-4094-8aa0-a05694f0e9a9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.702542] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6482cb8-f6ac-4094-8aa0-a05694f0e9a9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.751573] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.751721] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.009162] env[65783]: INFO networking_nsxv3.common.synchronization [req-dfee7c07-936c-4b27-a6a6-d62581aee85b req-876ccf8c-56ae-491e-b43a-dadda40b6995 tempest-ListServerFiltersTestJSON-326822078 tempest-ListServerFiltersTestJSON-326822078-project-member] Enqueued Resource ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 with Priority: HIGHEST for action security_group_members [ 935.010723] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 with Priority: HIGHEST for action security_group_members [ 935.011119] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-74220b44-588c-49ac-81cc-e6ac2b7c6024 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.011272] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.011341] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.011571] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.011839] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.012034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.012034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.012293] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.012415] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.012582] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.026297] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc55d75-4ce5-409b-958a-48efef735829 in Status: SUCCESS [ 935.026514] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.027371] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fcc697f-4055-405a-bcaa-722349f23210 in Status: SUCCESS [ 935.027644] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fcc697f-4055-405a-bcaa-722349f23210" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.027830] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.028191] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.028378] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.028497] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.028626] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.028800] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.028884] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.028980] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbc55d75-4ce5-409b-958a-48efef735829',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.029774] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fcc697f-4055-405a-bcaa-722349f23210" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.030477] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fcc697f-4055-405a-bcaa-722349f23210" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.030477] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.030477] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.030477] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.030727] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.030727] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.030794] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fcc697f-4055-405a-bcaa-722349f23210',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.055372] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 90e9a556-7bfa-416d-85c3-602fc0d01308 [ 935.055692] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.055692] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.055884] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.056135] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.056221] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.056333] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:90e9a556-7bfa-416d-85c3-602fc0d01308 already deleted. [ 935.056417] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90e9a556-7bfa-416d-85c3-602fc0d01308" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.172502] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.175167] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.175167] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.175167] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.175167] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.175167] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.175167] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.175167] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.175167] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.175167] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.175167] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.175167] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 already deleted. [ 935.175167] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.175167] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dccc2c0a-475d-4f38-ad2a-2e54cdca65b1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.208432] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b6482cb8-f6ac-4094-8aa0-a05694f0e9a9 [ 935.209172] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.209521] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.209667] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.210423] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.210423] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.210423] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b6482cb8-f6ac-4094-8aa0-a05694f0e9a9 already deleted. [ 935.210575] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6482cb8-f6ac-4094-8aa0-a05694f0e9a9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.427950] env[65783]: INFO networking_nsxv3.common.synchronization [req-f8b01e04-50dd-4f8c-a192-6f3001e95dbb req-cf9aadad-0ed8-4ded-8fd9-0b8e46358561 tempest-ServersTestMultiNic-291669374 tempest-ServersTestMultiNic-291669374-project-member] Enqueued Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 935.428503] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 935.428819] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.428931] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.428989] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.429628] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.429628] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.429895] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.429895] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.429895] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.430326] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.430467] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.515302] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.533492] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbc55d75-4ce5-409b-958a-48efef735829',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.539373] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.539373] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.539373] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.539373] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.539373] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.539373] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.539373] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.539373] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.539373] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.539373] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.539373] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fcc697f-4055-405a-bcaa-722349f23210 is going to be deleted. [ 935.570641] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.570955] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.570955] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.571087] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.571150] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.571313] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fcc697f-4055-405a-bcaa-722349f23210" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.571477] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fcc697f-4055-405a-bcaa-722349f23210" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.571670] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fcc697f-4055-405a-bcaa-722349f23210" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.571835] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.571938] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.572011] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.572790] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.572790] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.572790] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fcc697f-4055-405a-bcaa-722349f23210',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.636101] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b8bb0e6-1d22-4e95-a649-fc4d3180195b in Status: SUCCESS [ 935.636375] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b8bb0e6-1d22-4e95-a649-fc4d3180195b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.655257] env[65783]: INFO networking_nsxv3.common.synchronization [None req-97f90b4e-83a3-4827-b6b3-486d10267ef3 None None] Enqueued Resource ID: e7574382-fc70-407e-975a-2f49f2eb5122 with Priority: HIGHEST for action port [ 935.656601] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7574382-fc70-407e-975a-2f49f2eb5122 with Priority: HIGHEST for action port [ 935.656601] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7574382-fc70-407e-975a-2f49f2eb5122 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.656601] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7574382-fc70-407e-975a-2f49f2eb5122" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.656601] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7574382-fc70-407e-975a-2f49f2eb5122" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.657096] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7574382-fc70-407e-975a-2f49f2eb5122" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.657216] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7574382-fc70-407e-975a-2f49f2eb5122',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.677850] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.680099] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dccc2c0a-475d-4f38-ad2a-2e54cdca65b1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.813313] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-355 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.813524] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-355" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.813709] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-355" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.814719] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-355" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.814719] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.814719] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.814719] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.814719] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.815015] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.815053] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 935.815153] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 935.815259] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 935.815366] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 935.815476] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 935.815986] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 935.815986] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 935.834645] env[65783]: INFO networking_nsxv3.common.synchronization [req-1c932040-7da4-4f93-8303-722ab7a069b7 req-44b66417-11fb-43f3-a9bb-591e320ff742 tempest-AttachVolumeShelveTestJSON-903356803 tempest-AttachVolumeShelveTestJSON-903356803-project-member] Enqueued Resource ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b with Priority: HIGHEST for action security_group_members [ 935.836262] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 935.836362] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 935.836428] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 935.836605] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-355" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.836903] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-f795ad8a-6471-483d-a6b9-a381bad1c376 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.837158] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-f795ad8a-6471-483d-a6b9-a381bad1c376" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.837247] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-f795ad8a-6471-483d-a6b9-a381bad1c376" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.837869] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-f795ad8a-6471-483d-a6b9-a381bad1c376" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.837869] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f795ad8a-6471-483d-a6b9-a381bad1c376',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.838643] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b with Priority: HIGHEST for action security_group_members [ 935.839176] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.839289] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.839354] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.839562] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.839707] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.839798] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.839849] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.839990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.841159] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.841159] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdcea21f-f135-4ab1-9f28-d5be76c7c16b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.936449] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.939748] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.939954] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.940207] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.940307] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.940532] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.940638] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.940701] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.940859] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.940936] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.941071] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 already deleted. [ 935.941161] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.019072] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.041264] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbc55d75-4ce5-409b-958a-48efef735829',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.075857] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.076279] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.076279] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.076403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.076403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.076591] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.076690] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.076750] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.076905] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.076984] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.077078] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fcc697f-4055-405a-bcaa-722349f23210 already deleted. [ 936.077156] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fcc697f-4055-405a-bcaa-722349f23210" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.077414] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9fcc697f-4055-405a-bcaa-722349f23210',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.078220] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fcc697f-4055-405a-bcaa-722349f23210" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.078373] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fcc697f-4055-405a-bcaa-722349f23210" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.078570] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.078570] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.078570] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.078999] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.078999] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.078999] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fcc697f-4055-405a-bcaa-722349f23210',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.161432] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7574382-fc70-407e-975a-2f49f2eb5122 [ 936.161710] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.161844] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.161915] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.162228] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.162294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.162355] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7574382-fc70-407e-975a-2f49f2eb5122 already deleted. [ 936.162516] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7574382-fc70-407e-975a-2f49f2eb5122" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.179374] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.179687] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.179769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.179969] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.180214] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.180324] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 is going to be updated. [ 936.182302] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.182424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.182525] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.182784] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.182862] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.182942] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 is going to be updated. [ 936.214104] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.214252] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.214355] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.214531] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.214767] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.217529] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.217659] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.217718] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.218840] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.219031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.226566] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 in Status: IN_PROGRESS for 2s [ 936.227304] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: IN_PROGRESS for 2s [ 936.331568] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-738 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.331568] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-738" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.331568] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-738" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.331568] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-738" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.331853] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.332085] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.332085] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.332305] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.332491] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.332706] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 936.333604] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 936.333604] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 936.333604] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 936.333604] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 936.333604] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 936.333604] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 936.342626] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.342806] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.342936] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.343214] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.343357] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.343508] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port f795ad8a-6471-483d-a6b9-a381bad1c376 not found, creating... [ 936.343754] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.343910] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.344044] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.344262] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.344398] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.344723] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.344831] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.344937] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.345264] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.345345] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.345422] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: f795ad8a-6471-483d-a6b9-a381bad1c376 is going to be created. [ 936.346517] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.346626] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.346690] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.346839] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.346915] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.347093] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.347186] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.347245] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.347381] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.347460] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.347540] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b already deleted. [ 936.347618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.353022] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 936.353022] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 936.353022] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 936.353022] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-738" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.353022] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-eba2c4b7-13de-4fe3-95fb-86d9494cd97a taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.353022] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-eba2c4b7-13de-4fe3-95fb-86d9494cd97a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.353022] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-eba2c4b7-13de-4fe3-95fb-86d9494cd97a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.353022] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-eba2c4b7-13de-4fe3-95fb-86d9494cd97a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.353022] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eba2c4b7-13de-4fe3-95fb-86d9494cd97a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.368941] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.369202] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.369293] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.369562] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.369786] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.370015] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-f795ad8a-6471-483d-a6b9-a381bad1c376" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.522643] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.522824] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.522864] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.523095] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.523197] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.523280] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 is going to be updated. [ 936.543625] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.543859] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.543859] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.544090] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.544168] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.544273] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbc55d75-4ce5-409b-958a-48efef735829 is going to be updated. [ 936.558294] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.558581] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.558581] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.558721] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.558860] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.566647] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 in Status: IN_PROGRESS for 2s [ 936.580237] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9fcc697f-4055-405a-bcaa-722349f23210',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.582271] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.582271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.582271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.582622] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.582622] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.583692] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.583803] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.584039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.584039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.584155] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.584273] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.584362] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.584432] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.584562] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.584637] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.584718] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fcc697f-4055-405a-bcaa-722349f23210 already deleted. [ 936.584813] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fcc697f-4055-405a-bcaa-722349f23210" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.594931] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc55d75-4ce5-409b-958a-48efef735829 in Status: IN_PROGRESS for 2s [ 936.631922] env[65783]: INFO networking_nsxv3.common.synchronization [None req-a9f27d5d-dbd2-418b-8885-9ad7c977bb03 None None] Enqueued Resource ID: f67d29b4-9288-4734-8b89-91e980aed14b with Priority: HIGHEST for action port [ 936.633111] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f67d29b4-9288-4734-8b89-91e980aed14b with Priority: HIGHEST for action port [ 936.633434] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-f67d29b4-9288-4734-8b89-91e980aed14b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.633564] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f67d29b4-9288-4734-8b89-91e980aed14b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.633619] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f67d29b4-9288-4734-8b89-91e980aed14b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.633878] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f67d29b4-9288-4734-8b89-91e980aed14b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.633963] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f67d29b4-9288-4734-8b89-91e980aed14b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.854878] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.855134] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.855262] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.855534] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.855705] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.855885] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port eba2c4b7-13de-4fe3-95fb-86d9494cd97a not found, creating... [ 936.856158] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.856376] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.856602] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.856971] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.857141] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.857523] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.857735] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.857922] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.858235] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.858446] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.858622] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: eba2c4b7-13de-4fe3-95fb-86d9494cd97a is going to be created. [ 936.878725] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.878864] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.879048] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.879275] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.879498] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.879818] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-eba2c4b7-13de-4fe3-95fb-86d9494cd97a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.086067] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9fcc697f-4055-405a-bcaa-722349f23210: rpc.has_security_group_logging(os_id): False [ 937.115026] env[65783]: INFO networking_nsxv3.common.synchronization [req-f8b01e04-50dd-4f8c-a192-6f3001e95dbb req-44b8c02e-3aba-4b65-ab49-926046d30c78 service nova] Enqueued Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_rules [ 937.115026] env[65783]: INFO networking_nsxv3.common.synchronization [req-f8b01e04-50dd-4f8c-a192-6f3001e95dbb req-44b8c02e-3aba-4b65-ab49-926046d30c78 service nova] Enqueued Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 937.115026] env[65783]: INFO networking_nsxv3.common.synchronization [req-f8b01e04-50dd-4f8c-a192-6f3001e95dbb req-44b8c02e-3aba-4b65-ab49-926046d30c78 service nova] Enqueued Resource ID: f795ad8a-6471-483d-a6b9-a381bad1c376 with Priority: HIGHEST for action port [ 937.116125] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_rules [ 937.116265] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 937.117166] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f795ad8a-6471-483d-a6b9-a381bad1c376 with Priority: HIGHEST for action port [ 937.117166] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.117166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.117166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.117166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.117439] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.118232] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.118388] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.118447] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.119391] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.119391] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.119391] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.119391] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.119391] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.120322] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.120322] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.122646] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-f795ad8a-6471-483d-a6b9-a381bad1c376 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.122646] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f795ad8a-6471-483d-a6b9-a381bad1c376" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.122646] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f795ad8a-6471-483d-a6b9-a381bad1c376" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.122646] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f795ad8a-6471-483d-a6b9-a381bad1c376" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.122646] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f795ad8a-6471-483d-a6b9-a381bad1c376',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.129065] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.129373] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.129530] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.130027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.130027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.130325] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.132019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.132019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.132019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.132019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.132019] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fcc697f-4055-405a-bcaa-722349f23210 is going to be created. [ 937.135825] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f67d29b4-9288-4734-8b89-91e980aed14b [ 937.136302] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.136556] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.136712] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.136978] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.137174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.137348] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f67d29b4-9288-4734-8b89-91e980aed14b already deleted. [ 937.137537] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f67d29b4-9288-4734-8b89-91e980aed14b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.151613] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/9fcc697f-4055-405a-bcaa-722349f23210], does not exist path=[/infra/domains/default/groups/9fcc697f-4055-405a-bcaa-722349f23210]."\n}' [ 937.152598] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fcc697f-4055-405a-bcaa-722349f23210 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9fcc697f-4055-405a-bcaa-722349f23210 [ 937.152598] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 937.194443] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.194668] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.194668] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.194739] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.195860] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.197171] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.198069] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.198069] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.198069] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.198069] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.198069] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.198069] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.198069] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.198521] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.198521] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.198521] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fcc697f-4055-405a-bcaa-722349f23210 is going to be created. [ 937.217747] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/9fcc697f-4055-405a-bcaa-722349f23210], does not exist path=[/infra/domains/default/groups/9fcc697f-4055-405a-bcaa-722349f23210]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9fcc697f-4055-405a-bcaa-722349f23210 [ 937.217910] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9fcc697f-4055-405a-bcaa-722349f23210" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.218440] env[65783]: Traceback (most recent call last): [ 937.218518] env[65783]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 937.218518] env[65783]: return func(*args, **kwargs) [ 937.218518] env[65783]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 937.218518] env[65783]: res.raise_for_status() [ 937.218518] env[65783]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 937.218518] env[65783]: raise HTTPError(http_error_msg, response=self) [ 937.218518] env[65783]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9fcc697f-4055-405a-bcaa-722349f23210 [ 937.218518] env[65783]: During handling of the above exception, another exception occurred: [ 937.218518] env[65783]: Traceback (most recent call last): [ 937.218518] env[65783]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 937.218518] env[65783]: listener.cb(fileno) [ 937.218518] env[65783]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 937.218518] env[65783]: result = function(*args, **kwargs) [ 937.218518] env[65783]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 937.218518] env[65783]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 937.218518] env[65783]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 937.218518] env[65783]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 937.218518] env[65783]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 937.218518] env[65783]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 937.218518] env[65783]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 937.218518] env[65783]: res.raise_for_status() [ 937.218518] env[65783]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 937.218518] env[65783]: raise HTTPError(http_error_msg, response=self) [ 937.218518] env[65783]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9fcc697f-4055-405a-bcaa-722349f23210 [ 937.218518] env[65783]: Removing descriptor: 62 [ 937.394260] env[65783]: INFO networking_nsxv3.common.synchronization [req-52feeda4-4bd6-4463-ae7b-033d6f1d0903 req-29b5810a-0219-4d83-8122-a53caceeaba6 tempest-ImagesTestJSON-433702528 tempest-ImagesTestJSON-433702528-project-member] Enqueued Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 937.395260] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 937.395496] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.395637] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.395693] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.395894] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.396307] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.396307] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.396307] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.396524] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.396571] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.396635] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.621236] env[65783]: INFO networking_nsxv3.common.synchronization [req-1c932040-7da4-4f93-8303-722ab7a069b7 req-58c7c7d1-6ba6-4cca-adfc-525974f59337 service nova] Enqueued Resource ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b with Priority: HIGHEST for action security_group_rules [ 937.621236] env[65783]: INFO networking_nsxv3.common.synchronization [req-1c932040-7da4-4f93-8303-722ab7a069b7 req-58c7c7d1-6ba6-4cca-adfc-525974f59337 service nova] Enqueued Resource ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b with Priority: HIGHEST for action security_group_members [ 937.621236] env[65783]: INFO networking_nsxv3.common.synchronization [req-1c932040-7da4-4f93-8303-722ab7a069b7 req-58c7c7d1-6ba6-4cca-adfc-525974f59337 service nova] Enqueued Resource ID: eba2c4b7-13de-4fe3-95fb-86d9494cd97a with Priority: HIGHEST for action port [ 937.621236] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b with Priority: HIGHEST for action security_group_rules [ 937.621236] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b with Priority: HIGHEST for action security_group_members [ 937.621236] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eba2c4b7-13de-4fe3-95fb-86d9494cd97a with Priority: HIGHEST for action port [ 937.622036] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdcea21f-f135-4ab1-9f28-d5be76c7c16b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.622525] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.622804] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.623127] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.623437] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdcea21f-f135-4ab1-9f28-d5be76c7c16b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.624413] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.624710] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.624851] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.625103] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.625331] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.625523] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.625658] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.625939] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.627017] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.627017] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdcea21f-f135-4ab1-9f28-d5be76c7c16b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.629347] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-eba2c4b7-13de-4fe3-95fb-86d9494cd97a taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.629604] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eba2c4b7-13de-4fe3-95fb-86d9494cd97a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.629761] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eba2c4b7-13de-4fe3-95fb-86d9494cd97a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.630022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eba2c4b7-13de-4fe3-95fb-86d9494cd97a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.631016] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eba2c4b7-13de-4fe3-95fb-86d9494cd97a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.632066] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.632288] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.632861] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.633444] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f795ad8a-6471-483d-a6b9-a381bad1c376 with status ACTIVE [ 937.633716] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.635061] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.635061] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.635061] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.635061] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.635061] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.635061] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.635061] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.635061] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.635599] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.635892] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.636240] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.636394] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.636611] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.636765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.636918] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f795ad8a-6471-483d-a6b9-a381bad1c376 is going to be updated. [ 937.660231] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.660231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.660231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.660231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.660231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.660231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f795ad8a-6471-483d-a6b9-a381bad1c376" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.901714] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.901714] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.901714] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.901945] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.923297] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.923398] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.923608] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.923608] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.923772] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.923853] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.923939] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd942bf-b305-4707-8084-1ac6b135c741 is going to be updated. [ 937.944199] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-757 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.944685] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-757" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.944685] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-757" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.944941] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-757" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.945239] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.945401] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.945516] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.945737] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.945877] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.946090] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 937.946200] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 937.946434] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 937.946434] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 937.946575] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 937.946610] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 937.946718] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 937.952292] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.952644] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.952644] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.952644] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.952800] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.960875] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: IN_PROGRESS for 2s [ 937.967157] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 937.967538] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 937.967538] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 937.967666] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-757" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.967977] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-22f6c5a6-c617-44cd-9f61-61773c5a18f6 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.968167] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-22f6c5a6-c617-44cd-9f61-61773c5a18f6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.968288] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-22f6c5a6-c617-44cd-9f61-61773c5a18f6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.968604] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-22f6c5a6-c617-44cd-9f61-61773c5a18f6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.968746] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22f6c5a6-c617-44cd-9f61-61773c5a18f6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.131976] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.135027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.135027] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fdcea21f-f135-4ab1-9f28-d5be76c7c16b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.138407] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eba2c4b7-13de-4fe3-95fb-86d9494cd97a with status ACTIVE [ 938.138653] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.139344] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.139553] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.140189] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.140305] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.140551] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.140838] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.140954] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.141230] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.141486] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.142124] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.142880] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.143160] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.143418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.143589] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.143787] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eba2c4b7-13de-4fe3-95fb-86d9494cd97a is going to be updated. [ 938.145475] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.182033] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.182903] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.183721] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.184987] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.184987] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.184987] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eba2c4b7-13de-4fe3-95fb-86d9494cd97a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.239919] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: SUCCESS [ 938.240158] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.240328] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.240665] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.240865] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.241048] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.241121] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.241293] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.241418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.241455] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.241622] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.241721] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.241784] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.241928] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.242405] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.242589] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.243481] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.243481] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.243481] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.243481] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.243481] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.245428] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 in Status: SUCCESS [ 938.245823] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.246224] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.246459] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.246658] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.246819] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.246920] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.247132] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.247251] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.247700] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.247700] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dccc2c0a-475d-4f38-ad2a-2e54cdca65b1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.470970] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.471218] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.471342] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.471618] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.471780] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.471945] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 22f6c5a6-c617-44cd-9f61-61773c5a18f6 not found, creating... [ 938.472222] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.472499] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.472499] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.472741] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.472878] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.473168] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.473323] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.473441] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.473678] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.473807] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.473944] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 22f6c5a6-c617-44cd-9f61-61773c5a18f6 is going to be created. [ 938.501039] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.502281] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.502281] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.502281] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.502281] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.502568] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-22f6c5a6-c617-44cd-9f61-61773c5a18f6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.577182] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 in Status: SUCCESS [ 938.577425] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.605852] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc55d75-4ce5-409b-958a-48efef735829 in Status: SUCCESS [ 938.606087] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.606261] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.606492] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.606691] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.606809] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.606867] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.607045] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.607130] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.607249] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.607309] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cbc55d75-4ce5-409b-958a-48efef735829',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.608248] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.608424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.608611] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.608781] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.608841] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.609016] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.609095] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.609195] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbc55d75-4ce5-409b-958a-48efef735829',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.635848] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fdcea21f-f135-4ab1-9f28-d5be76c7c16b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.650104] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.650307] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.650307] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.650529] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.650611] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.650707] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 is going to be created. [ 938.676963] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.677190] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.677190] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.677473] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.677561] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.687998] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: UNINITIALIZED for 2s [ 938.749908] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6: rpc.has_security_group_logging(os_id): False [ 938.751766] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dccc2c0a-475d-4f38-ad2a-2e54cdca65b1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.787326] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.787578] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.787662] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.787843] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.811032] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.811297] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.811430] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.811516] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.811750] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.811836] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.812074] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.812183] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.812238] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.812390] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.812474] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.812679] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.812778] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.812833] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.812977] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.813564] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.813668] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 is going to be updated. [ 938.900508] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.900859] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.900859] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.901085] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.901179] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.915562] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: IN_PROGRESS for 2s [ 939.071543] env[65783]: INFO networking_nsxv3.common.synchronization [req-56917995-ded9-4b36-8d4d-6e3ee976923d req-910e580a-e75b-45bc-a670-bc052b9993c5 tempest-ImagesOneServerNegativeTestJSON-1524253690 tempest-ImagesOneServerNegativeTestJSON-1524253690-project-member] Enqueued Resource ID: 6432899c-b0aa-4285-971f-16ac27b1305b with Priority: HIGHEST for action security_group_members [ 939.071543] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6432899c-b0aa-4285-971f-16ac27b1305b with Priority: HIGHEST for action security_group_members [ 939.073217] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-6432899c-b0aa-4285-971f-16ac27b1305b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.073444] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.073533] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.073768] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.073946] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.074108] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.074252] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.074479] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.074649] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.074694] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6432899c-b0aa-4285-971f-16ac27b1305b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.111166] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc55d75-4ce5-409b-958a-48efef735829 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.111166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.111380] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbc55d75-4ce5-409b-958a-48efef735829',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.138542] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.138709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.138818] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.138986] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.139061] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.139141] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b is going to be created. [ 939.164726] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.164931] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.164931] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.165568] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.165926] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.180660] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b in Status: UNINITIALIZED for 2s [ 939.248067] env[65783]: INFO networking_nsxv3.common.synchronization [req-f8b01e04-50dd-4f8c-a192-6f3001e95dbb req-bffea2cc-1197-41f6-8bfc-708c2118a436 service nova] Enqueued Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_rules [ 939.248067] env[65783]: INFO networking_nsxv3.common.synchronization [req-f8b01e04-50dd-4f8c-a192-6f3001e95dbb req-bffea2cc-1197-41f6-8bfc-708c2118a436 service nova] Enqueued Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 939.248067] env[65783]: INFO networking_nsxv3.common.synchronization [req-f8b01e04-50dd-4f8c-a192-6f3001e95dbb req-bffea2cc-1197-41f6-8bfc-708c2118a436 service nova] Enqueued Resource ID: 22f6c5a6-c617-44cd-9f61-61773c5a18f6 with Priority: HIGHEST for action port [ 939.248067] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_rules [ 939.248349] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 939.248490] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22f6c5a6-c617-44cd-9f61-61773c5a18f6 with Priority: HIGHEST for action port [ 939.249388] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.249388] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.250225] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.250225] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.250225] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-22f6c5a6-c617-44cd-9f61-61773c5a18f6 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.250406] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22f6c5a6-c617-44cd-9f61-61773c5a18f6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.250707] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22f6c5a6-c617-44cd-9f61-61773c5a18f6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.250909] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22f6c5a6-c617-44cd-9f61-61773c5a18f6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.251036] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22f6c5a6-c617-44cd-9f61-61773c5a18f6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.254687] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dccc2c0a-475d-4f38-ad2a-2e54cdca65b1: rpc.has_security_group_logging(os_id): False [ 939.286935] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.286935] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.286935] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.286935] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.326204] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.326527] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.326668] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.326738] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.326965] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.327064] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.327159] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 is going to be updated. [ 939.404673] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.404963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.405069] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.405359] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.405552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.418708] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 in Status: IN_PROGRESS for 2s [ 939.527671] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-169 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.527986] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-169" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.528294] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-169" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.528355] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-169" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.528597] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.528754] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.528867] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.529242] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.529447] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.529692] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 939.529835] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 939.529968] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 939.530114] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 939.530252] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 939.530507] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 939.530593] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 939.553590] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 939.553883] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 939.554088] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 939.554331] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-169" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.554710] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-00af96db-551c-48f3-9b82-c272038d58a8 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.554937] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-00af96db-551c-48f3-9b82-c272038d58a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.555111] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-00af96db-551c-48f3-9b82-c272038d58a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.555513] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-00af96db-551c-48f3-9b82-c272038d58a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.555689] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00af96db-551c-48f3-9b82-c272038d58a8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.578202] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.578409] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.578498] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.578729] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.613201] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.613609] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.613781] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.613859] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.614147] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.614278] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.614412] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6432899c-b0aa-4285-971f-16ac27b1305b is going to be updated. [ 939.616137] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbc55d75-4ce5-409b-958a-48efef735829',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.649101] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.650507] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.650507] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.650507] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.650507] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.661092] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6432899c-b0aa-4285-971f-16ac27b1305b in Status: IN_PROGRESS for 2s [ 939.753762] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 22f6c5a6-c617-44cd-9f61-61773c5a18f6 with status ACTIVE [ 939.754020] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.754171] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.754243] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.754482] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.754573] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.754821] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.754901] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.754939] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.755142] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.755223] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.755417] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.755529] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.755596] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.755748] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.755864] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.755909] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 22f6c5a6-c617-44cd-9f61-61773c5a18f6 is going to be updated. [ 939.776645] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.776781] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.776846] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.777837] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.777837] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.777837] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22f6c5a6-c617-44cd-9f61-61773c5a18f6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.041961] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: SUCCESS [ 940.041961] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd942bf-b305-4707-8084-1ac6b135c741 deletion is rescheduled due to dependency. [ 940.041961] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.058298] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.058901] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.058901] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.059094] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.059323] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.059810] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 00af96db-551c-48f3-9b82-c272038d58a8 not found, creating... [ 940.059919] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.060102] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.061325] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.061325] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.061325] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.061325] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.061325] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.061896] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.061896] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.061896] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.062079] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 00af96db-551c-48f3-9b82-c272038d58a8 is going to be created. [ 940.065196] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-355 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.065449] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-355" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.065649] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-355" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.065980] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-355" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.066369] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.066641] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.066851] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.067166] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.067366] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.067634] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 940.067802] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 940.067925] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 940.068080] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 940.068229] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 940.068360] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 940.068539] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 940.088697] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 940.088909] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 940.089075] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 940.089261] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-355" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.089583] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-0c9e89f7-4194-4cd0-86aa-72b4f8655f1e taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.089758] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-0c9e89f7-4194-4cd0-86aa-72b4f8655f1e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.089876] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-0c9e89f7-4194-4cd0-86aa-72b4f8655f1e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.090244] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-0c9e89f7-4194-4cd0-86aa-72b4f8655f1e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.090388] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c9e89f7-4194-4cd0-86aa-72b4f8655f1e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.092157] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.092285] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.092407] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.092739] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.092945] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.093177] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-00af96db-551c-48f3-9b82-c272038d58a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.119308] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.119537] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.119537] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.119706] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.119850] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.119959] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbc55d75-4ce5-409b-958a-48efef735829 is going to be updated. [ 940.146451] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.146657] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.146657] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.146868] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.147027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.156081] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc55d75-4ce5-409b-958a-48efef735829 in Status: IN_PROGRESS for 2s [ 940.595555] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.596045] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.596045] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.596045] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.596226] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.596411] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 0c9e89f7-4194-4cd0-86aa-72b4f8655f1e not found, creating... [ 940.596625] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.596854] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.596942] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.597130] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.597258] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.597548] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.597714] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.597817] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.598047] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.598178] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.598729] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 0c9e89f7-4194-4cd0-86aa-72b4f8655f1e is going to be created. [ 940.620537] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.620758] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.620932] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.621197] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.621466] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.621705] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-0c9e89f7-4194-4cd0-86aa-72b4f8655f1e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.699206] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: SUCCESS [ 940.699581] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.699650] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.699885] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.700066] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.700183] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.700243] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.700400] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.700513] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.700683] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.700683] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.701693] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.701863] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.702036] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.702148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.702210] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.702353] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.702437] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.702533] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.821159] env[65783]: INFO networking_nsxv3.common.synchronization [req-56917995-ded9-4b36-8d4d-6e3ee976923d req-cfe9be73-5cc3-40c2-83d8-7ea817ab3a8a service nova] Enqueued Resource ID: 6432899c-b0aa-4285-971f-16ac27b1305b with Priority: HIGHEST for action security_group_rules [ 940.821344] env[65783]: INFO networking_nsxv3.common.synchronization [req-56917995-ded9-4b36-8d4d-6e3ee976923d req-cfe9be73-5cc3-40c2-83d8-7ea817ab3a8a service nova] Enqueued Resource ID: 6432899c-b0aa-4285-971f-16ac27b1305b with Priority: HIGHEST for action security_group_members [ 940.821482] env[65783]: INFO networking_nsxv3.common.synchronization [req-56917995-ded9-4b36-8d4d-6e3ee976923d req-cfe9be73-5cc3-40c2-83d8-7ea817ab3a8a service nova] Enqueued Resource ID: 00af96db-551c-48f3-9b82-c272038d58a8 with Priority: HIGHEST for action port [ 940.822009] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6432899c-b0aa-4285-971f-16ac27b1305b with Priority: HIGHEST for action security_group_rules [ 940.822712] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6432899c-b0aa-4285-971f-16ac27b1305b with Priority: HIGHEST for action security_group_members [ 940.822817] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00af96db-551c-48f3-9b82-c272038d58a8 with Priority: HIGHEST for action port [ 940.823104] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6432899c-b0aa-4285-971f-16ac27b1305b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.823249] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.823313] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.823478] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.823586] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6432899c-b0aa-4285-971f-16ac27b1305b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.825825] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-6432899c-b0aa-4285-971f-16ac27b1305b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.825933] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.826158] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-00af96db-551c-48f3-9b82-c272038d58a8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.826307] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00af96db-551c-48f3-9b82-c272038d58a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.826416] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00af96db-551c-48f3-9b82-c272038d58a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.826667] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00af96db-551c-48f3-9b82-c272038d58a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.828403] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00af96db-551c-48f3-9b82-c272038d58a8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.932581] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: SUCCESS [ 940.932869] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.933058] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.933272] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.933360] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.177394] env[65783]: INFO networking_nsxv3.common.synchronization [None req-49a04d29-d1e8-4639-90bf-abb65a632198 tempest-ServersTestManualDisk-213355435 tempest-ServersTestManualDisk-213355435-project-member] Enqueued Resource ID: 72614839-90ad-4218-8056-d4c6f35d8448 with Priority: HIGHEST for action security_group_rules [ 941.177913] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72614839-90ad-4218-8056-d4c6f35d8448 with Priority: HIGHEST for action security_group_rules [ 941.178228] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72614839-90ad-4218-8056-d4c6f35d8448 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.178353] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.178418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.178678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.178761] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72614839-90ad-4218-8056-d4c6f35d8448',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.192723] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b in Status: SUCCESS [ 941.192923] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.193369] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.193590] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.193775] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.193893] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.193959] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.194132] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.194214] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.194299] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.194391] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fdcea21f-f135-4ab1-9f28-d5be76c7c16b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.204688] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.204879] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.205141] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.330884] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-6432899c-b0aa-4285-971f-16ac27b1305b taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.330884] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.331954] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 00af96db-551c-48f3-9b82-c272038d58a8 with status ACTIVE [ 941.332409] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.332637] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.332727] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.333137] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.333137] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.333277] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.333376] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.333434] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.333617] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.333691] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.335431] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.335431] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.335431] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.335431] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.335431] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.335431] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 00af96db-551c-48f3-9b82-c272038d58a8 is going to be updated. [ 941.337041] env[65783]: INFO networking_nsxv3.common.synchronization [req-f8b01e04-50dd-4f8c-a192-6f3001e95dbb req-1141e900-4b02-463a-a923-f9cc44a3de90 service nova] Enqueued Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_rules [ 941.337041] env[65783]: INFO networking_nsxv3.common.synchronization [req-f8b01e04-50dd-4f8c-a192-6f3001e95dbb req-1141e900-4b02-463a-a923-f9cc44a3de90 service nova] Enqueued Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 941.337041] env[65783]: INFO networking_nsxv3.common.synchronization [req-f8b01e04-50dd-4f8c-a192-6f3001e95dbb req-1141e900-4b02-463a-a923-f9cc44a3de90 service nova] Enqueued Resource ID: 0c9e89f7-4194-4cd0-86aa-72b4f8655f1e with Priority: HIGHEST for action port [ 941.337453] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_rules [ 941.337589] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 941.337687] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c9e89f7-4194-4cd0-86aa-72b4f8655f1e with Priority: HIGHEST for action port [ 941.338616] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.339462] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.339462] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.339462] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.339462] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c9e89f7-4194-4cd0-86aa-72b4f8655f1e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.339462] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c9e89f7-4194-4cd0-86aa-72b4f8655f1e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.339707] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c9e89f7-4194-4cd0-86aa-72b4f8655f1e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.340024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c9e89f7-4194-4cd0-86aa-72b4f8655f1e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.340105] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c9e89f7-4194-4cd0-86aa-72b4f8655f1e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.358366] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.358533] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.358578] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.358784] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.359160] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.359334] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00af96db-551c-48f3-9b82-c272038d58a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.398764] env[65783]: INFO networking_nsxv3.common.synchronization [None req-1c0b3326-e364-4167-8d26-3201a44a6f6c tempest-ServersTestManualDisk-213355435 tempest-ServersTestManualDisk-213355435-project-member] Enqueued Resource ID: 72614839-90ad-4218-8056-d4c6f35d8448 with Priority: HIGHEST for action security_group_rules [ 941.399507] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72614839-90ad-4218-8056-d4c6f35d8448 with Priority: HIGHEST for action security_group_rules [ 941.400070] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72614839-90ad-4218-8056-d4c6f35d8448 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.400176] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.432711] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 in Status: SUCCESS [ 941.432711] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.435318] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.435443] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.435514] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.435707] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.435875] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.435973] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.436038] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.436194] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.436276] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.436361] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.436451] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.670498] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6432899c-b0aa-4285-971f-16ac27b1305b in Status: SUCCESS [ 941.670723] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6432899c-b0aa-4285-971f-16ac27b1305b deletion is rescheduled due to dependency. [ 941.670830] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.670992] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.671214] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.671390] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.671505] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.671562] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.671709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.671789] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.671882] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6432899c-b0aa-4285-971f-16ac27b1305b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.698820] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.698971] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.699053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.699279] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.699507] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.699507] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72614839-90ad-4218-8056-d4c6f35d8448 already deleted. [ 941.699595] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.699822] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fdcea21f-f135-4ab1-9f28-d5be76c7c16b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.700901] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.704253] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.704348] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72614839-90ad-4218-8056-d4c6f35d8448',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.708665] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.842866] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0c9e89f7-4194-4cd0-86aa-72b4f8655f1e with status ACTIVE [ 941.843111] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.843241] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.843308] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.843536] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.843789] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.843789] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.844929] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.844929] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.844929] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.844929] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.844929] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.844929] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.844929] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.844929] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.844929] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.844929] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0c9e89f7-4194-4cd0-86aa-72b4f8655f1e is going to be updated. [ 941.867705] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.867935] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.867935] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.868642] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.868642] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.868642] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c9e89f7-4194-4cd0-86aa-72b4f8655f1e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.939615] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.939805] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.939865] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.940114] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.940285] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.940391] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.940552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.940626] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.940708] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.940798] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.940952] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.941235] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.941235] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.941235] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.941382] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.941541] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.941607] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.941752] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.941828] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.941907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.942014] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.165435] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc55d75-4ce5-409b-958a-48efef735829 in Status: SUCCESS [ 942.165660] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.165827] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.166074] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.166279] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.166365] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.166447] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.166588] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.166658] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.166753] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbc55d75-4ce5-409b-958a-48efef735829',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.174581] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6432899c-b0aa-4285-971f-16ac27b1305b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.205857] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fdcea21f-f135-4ab1-9f28-d5be76c7c16b: rpc.has_security_group_logging(os_id): False [ 942.210848] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.211009] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.211099] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.211304] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.211402] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.211500] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 is going to be updated. [ 942.236800] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.237022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.237022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.237232] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.237354] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.237484] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72614839-90ad-4218-8056-d4c6f35d8448 already deleted. [ 942.237564] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.238496] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.238634] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.238725] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.238925] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.239070] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.239376] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.239552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.239625] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.239728] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.239826] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.239889] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b is going to be created. [ 942.255521] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.255767] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.255767] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.255956] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.256089] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.267862] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: IN_PROGRESS for 2s [ 942.316521] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.316755] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.316755] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.316958] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.317349] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.330570] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b in Status: IN_PROGRESS for 2s [ 942.445019] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6: rpc.has_security_group_logging(os_id): False [ 942.464048] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.464048] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.464048] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.464268] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.464268] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.464441] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.464545] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.464609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.464763] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.464854] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.465042] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.465140] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.465207] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.465351] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.465425] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.465617] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.465724] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.465780] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.465925] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.466867] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.466867] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 is going to be updated. [ 942.538039] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.538039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.538266] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.538511] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.538796] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.559110] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: IN_PROGRESS for 2s [ 942.669759] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbc55d75-4ce5-409b-958a-48efef735829',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.677106] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6432899c-b0aa-4285-971f-16ac27b1305b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.743409] env[65783]: INFO networking_nsxv3.common.synchronization [req-a3237374-c546-46a2-86cd-b1b1ee67a68b req-77f80e03-dd50-4e81-a083-1ed6031207bb tempest-AttachVolumeNegativeTest-1814624860 tempest-AttachVolumeNegativeTest-1814624860-project-member] Enqueued Resource ID: 21a0bbd4-6f51-4a42-b423-363e65f0247c with Priority: HIGHEST for action security_group_members [ 942.744409] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21a0bbd4-6f51-4a42-b423-363e65f0247c with Priority: HIGHEST for action security_group_members [ 942.744994] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-21a0bbd4-6f51-4a42-b423-363e65f0247c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.745178] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.745261] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.745739] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.745886] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.746030] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.746072] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.746269] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.746356] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.746455] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21a0bbd4-6f51-4a42-b423-363e65f0247c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.173738] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbc55d75-4ce5-409b-958a-48efef735829',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.179743] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.182444] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.182444] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.182444] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.182444] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.182444] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6432899c-b0aa-4285-971f-16ac27b1305b is going to be updated. [ 943.229084] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.229203] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.229877] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.229877] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.229877] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.240768] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-552 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.241143] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-552" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.241352] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-552" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.241748] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-552" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.242141] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.242327] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.242446] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.242756] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.242867] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.243103] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 943.243217] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 943.243333] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 943.243441] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 943.243573] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 943.243687] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 943.243820] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 943.247807] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6432899c-b0aa-4285-971f-16ac27b1305b in Status: IN_PROGRESS for 2s [ 943.250985] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.250985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.250985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.250985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.250985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.250985] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.250985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.250985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.250985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.250985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.250985] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21a0bbd4-6f51-4a42-b423-363e65f0247c already deleted. [ 943.250985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.288099] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 943.288350] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.044 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 943.288505] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 943.289423] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-552" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.289423] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-b62b03bf-7b53-4c01-880d-43cd9bf586f6 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.289423] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-b62b03bf-7b53-4c01-880d-43cd9bf586f6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.289423] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-b62b03bf-7b53-4c01-880d-43cd9bf586f6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.289731] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-b62b03bf-7b53-4c01-880d-43cd9bf586f6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.289926] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b62b03bf-7b53-4c01-880d-43cd9bf586f6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.675258] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.675508] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.675654] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.675891] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.675983] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.676096] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbc55d75-4ce5-409b-958a-48efef735829 is going to be updated. [ 943.704126] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.704676] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.704676] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.704676] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.704826] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.717059] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc55d75-4ce5-409b-958a-48efef735829 in Status: IN_PROGRESS for 2s [ 943.795137] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.795137] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.795137] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.795137] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.795137] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.795137] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port b62b03bf-7b53-4c01-880d-43cd9bf586f6 not found, creating... [ 943.795137] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.795137] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.795137] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.795137] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.795137] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.795745] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.795745] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.795745] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.795923] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.796191] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.796427] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: b62b03bf-7b53-4c01-880d-43cd9bf586f6 is going to be created. [ 943.821256] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.823020] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.823020] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.823020] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.823020] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.823020] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-b62b03bf-7b53-4c01-880d-43cd9bf586f6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.277795] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: SUCCESS [ 944.281148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.281148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.281148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.281148] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.281148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.281148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.281148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.281148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.281148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.281148] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.281148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.281148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.281148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.281148] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.281148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.281148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.281148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.281148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.281695] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.281695] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.281695] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.281695] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.281805] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.281945] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.281945] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.282107] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.282204] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.282238] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.351476] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b in Status: SUCCESS [ 944.351618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.551241] env[65783]: INFO networking_nsxv3.common.synchronization [req-a3237374-c546-46a2-86cd-b1b1ee67a68b req-33e99363-920d-4e4d-b986-8a312282d859 service nova] Enqueued Resource ID: 21a0bbd4-6f51-4a42-b423-363e65f0247c with Priority: HIGHEST for action security_group_rules [ 944.551241] env[65783]: INFO networking_nsxv3.common.synchronization [req-a3237374-c546-46a2-86cd-b1b1ee67a68b req-33e99363-920d-4e4d-b986-8a312282d859 service nova] Enqueued Resource ID: 21a0bbd4-6f51-4a42-b423-363e65f0247c with Priority: HIGHEST for action security_group_members [ 944.551328] env[65783]: INFO networking_nsxv3.common.synchronization [req-a3237374-c546-46a2-86cd-b1b1ee67a68b req-33e99363-920d-4e4d-b986-8a312282d859 service nova] Enqueued Resource ID: b62b03bf-7b53-4c01-880d-43cd9bf586f6 with Priority: HIGHEST for action port [ 944.551876] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21a0bbd4-6f51-4a42-b423-363e65f0247c with Priority: HIGHEST for action security_group_rules [ 944.552020] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21a0bbd4-6f51-4a42-b423-363e65f0247c with Priority: HIGHEST for action security_group_members [ 944.552261] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62b03bf-7b53-4c01-880d-43cd9bf586f6 with Priority: HIGHEST for action port [ 944.552571] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21a0bbd4-6f51-4a42-b423-363e65f0247c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.552692] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.552760] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.552963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.553053] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21a0bbd4-6f51-4a42-b423-363e65f0247c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.555122] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-21a0bbd4-6f51-4a42-b423-363e65f0247c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.555238] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.555304] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.555524] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.555631] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.555724] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.555790] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.555929] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.556025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.556194] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21a0bbd4-6f51-4a42-b423-363e65f0247c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.556944] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-b62b03bf-7b53-4c01-880d-43cd9bf586f6 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.557083] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b62b03bf-7b53-4c01-880d-43cd9bf586f6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.557182] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b62b03bf-7b53-4c01-880d-43cd9bf586f6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.557324] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b62b03bf-7b53-4c01-880d-43cd9bf586f6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.557398] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b62b03bf-7b53-4c01-880d-43cd9bf586f6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.575973] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: SUCCESS [ 944.576118] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.785662] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.786687] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bbf64d2-1030-46ae-99d0-42b29d7d0132: rpc.has_security_group_logging(os_id): False [ 944.805285] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.805687] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.805687] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.805687] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.805791] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.805980] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.806085] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.806146] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.806295] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.806368] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.806581] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.806725] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.806725] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.806863] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.806933] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.807129] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.807210] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.808193] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.808193] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.808193] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.808193] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 is going to be created. [ 944.868411] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.868565] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.868649] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.868855] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.869055] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.881081] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: IN_PROGRESS for 2s [ 945.060688] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b62b03bf-7b53-4c01-880d-43cd9bf586f6 with status ACTIVE [ 945.060688] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.060931] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.060974] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.061610] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.061610] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.061610] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.061823] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.061823] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.061927] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.062055] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.062189] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.062360] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.062360] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.062599] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.064404] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.064404] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b62b03bf-7b53-4c01-880d-43cd9bf586f6 is going to be updated. [ 945.064404] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21a0bbd4-6f51-4a42-b423-363e65f0247c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.065220] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-21a0bbd4-6f51-4a42-b423-363e65f0247c taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.065332] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.089737] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.090744] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.090744] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.090744] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.091526] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.091741] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b62b03bf-7b53-4c01-880d-43cd9bf586f6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.260895] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6432899c-b0aa-4285-971f-16ac27b1305b in Status: SUCCESS [ 945.261152] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.261344] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.261576] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.261795] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.261915] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.262069] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.262165] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.262256] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.262344] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.262437] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6432899c-b0aa-4285-971f-16ac27b1305b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.288737] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.397500] env[65783]: INFO networking_nsxv3.common.synchronization [req-27fabe4c-5499-4c34-950a-93fdff8f2c97 req-86b0854a-7e4a-47eb-ac7f-60911adf85b4 tempest-ImagesOneServerTestJSON-102617875 tempest-ImagesOneServerTestJSON-102617875-project-member] Enqueued Resource ID: 05d32358-32a3-497c-a1f6-14de2057f1b3 with Priority: HIGHEST for action security_group_members [ 945.398117] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05d32358-32a3-497c-a1f6-14de2057f1b3 with Priority: HIGHEST for action security_group_members [ 945.400478] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-05d32358-32a3-497c-a1f6-14de2057f1b3 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.400478] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.400478] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.400478] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.400478] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.400478] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.400478] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.400478] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.400478] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.400478] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05d32358-32a3-497c-a1f6-14de2057f1b3',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.567243] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21a0bbd4-6f51-4a42-b423-363e65f0247c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.730385] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc55d75-4ce5-409b-958a-48efef735829 in Status: SUCCESS [ 945.730744] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.730983] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.731305] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.731611] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.731793] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.731842] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.731977] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.732073] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.732186] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.732360] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc55d75-4ce5-409b-958a-48efef735829 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.732626] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.732626] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.732869] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.734036] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.734036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.734036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.734036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.734036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.734036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.734036] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cbc55d75-4ce5-409b-958a-48efef735829',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.766026] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-6432899c-b0aa-4285-971f-16ac27b1305b taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.766211] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.766250] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.766451] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.766634] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.766728] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.766766] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.766915] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.767012] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.767242] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.767422] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-6432899c-b0aa-4285-971f-16ac27b1305b taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.767573] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.767765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.767949] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.768494] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.768494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.768494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.768494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.768494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.768756] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.768790] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6432899c-b0aa-4285-971f-16ac27b1305b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.791271] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.791433] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.791507] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.792090] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.792090] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.792090] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 is going to be updated. [ 945.824322] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.824674] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.824674] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.824854] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.825071] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.833431] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-408 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.833770] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-408" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.833844] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-408" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.834160] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-408" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.834425] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.834585] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.834708] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.834913] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.835339] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.835608] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 945.836159] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 945.836331] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 945.836540] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 945.836720] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 945.836866] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 945.837039] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 945.839355] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: IN_PROGRESS for 2s [ 945.859323] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 945.859835] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 945.860107] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 945.860319] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-408" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.860714] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-6e2a5ea0-49ef-4baf-8210-ab0ca08a7d48 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.860934] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-6e2a5ea0-49ef-4baf-8210-ab0ca08a7d48" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.861073] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-6e2a5ea0-49ef-4baf-8210-ab0ca08a7d48" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.861416] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-6e2a5ea0-49ef-4baf-8210-ab0ca08a7d48" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.861670] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e2a5ea0-49ef-4baf-8210-ab0ca08a7d48',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.904472] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.904628] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.908018] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.908018] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.908018] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.908018] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.908018] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.908018] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.908018] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.908018] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.908018] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05d32358-32a3-497c-a1f6-14de2057f1b3 already deleted. [ 945.908018] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.070592] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.070980] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.070980] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.071136] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.071238] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.071366] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21a0bbd4-6f51-4a42-b423-363e65f0247c is going to be created. [ 946.097224] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.097423] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.097515] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.097788] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.098014] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.109238] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21a0bbd4-6f51-4a42-b423-363e65f0247c in Status: UNINITIALIZED for 2s [ 946.236306] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cbc55d75-4ce5-409b-958a-48efef735829: rpc.has_security_group_logging(os_id): False [ 946.255836] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.256016] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.256073] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.256267] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.271033] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6432899c-b0aa-4285-971f-16ac27b1305b: rpc.has_security_group_logging(os_id): False [ 946.277223] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.277495] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.277618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.277715] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.277971] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.278087] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.278492] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.278492] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.278492] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.278659] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.278714] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.278882] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.278992] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.279069] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.279218] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.279302] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.279457] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbc55d75-4ce5-409b-958a-48efef735829 is going to be updated. [ 946.305133] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.305133] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.305133] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.305133] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.305133] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.305133] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.305133] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.305133] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.305618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.305618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.305618] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.305618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.305618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.305809] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.305809] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.306130] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.306130] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.306285] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.306285] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.306369] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.306439] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6432899c-b0aa-4285-971f-16ac27b1305b is going to be updated. [ 946.365412] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.365687] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.365770] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.366077] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.366226] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.366379] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 6e2a5ea0-49ef-4baf-8210-ab0ca08a7d48 not found, creating... [ 946.366875] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.366875] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.367064] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.367165] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.367298] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.367810] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.368101] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.368303] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.368499] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.368675] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.368826] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 6e2a5ea0-49ef-4baf-8210-ab0ca08a7d48 is going to be created. [ 946.404561] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.404726] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.404800] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.405025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.405175] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.407701] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.407847] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.407885] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.408087] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.408223] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.411569] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.411911] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.412079] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.412372] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.412841] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.413023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-6e2a5ea0-49ef-4baf-8210-ab0ca08a7d48" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.427251] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbc55d75-4ce5-409b-958a-48efef735829 in Status: IN_PROGRESS for 2s [ 946.427251] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6432899c-b0aa-4285-971f-16ac27b1305b in Status: IN_PROGRESS for 2s [ 946.893626] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: SUCCESS [ 946.893907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.894111] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.894323] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.894406] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.164825] env[65783]: INFO networking_nsxv3.common.synchronization [req-27fabe4c-5499-4c34-950a-93fdff8f2c97 req-e199aec5-e9ab-43f7-ae7c-262ab1578cdf service nova] Enqueued Resource ID: 05d32358-32a3-497c-a1f6-14de2057f1b3 with Priority: HIGHEST for action security_group_rules [ 947.165114] env[65783]: INFO networking_nsxv3.common.synchronization [req-27fabe4c-5499-4c34-950a-93fdff8f2c97 req-e199aec5-e9ab-43f7-ae7c-262ab1578cdf service nova] Enqueued Resource ID: 05d32358-32a3-497c-a1f6-14de2057f1b3 with Priority: HIGHEST for action security_group_members [ 947.165319] env[65783]: INFO networking_nsxv3.common.synchronization [req-27fabe4c-5499-4c34-950a-93fdff8f2c97 req-e199aec5-e9ab-43f7-ae7c-262ab1578cdf service nova] Enqueued Resource ID: 6e2a5ea0-49ef-4baf-8210-ab0ca08a7d48 with Priority: HIGHEST for action port [ 947.166520] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05d32358-32a3-497c-a1f6-14de2057f1b3 with Priority: HIGHEST for action security_group_rules [ 947.166520] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05d32358-32a3-497c-a1f6-14de2057f1b3 with Priority: HIGHEST for action security_group_members [ 947.166669] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e2a5ea0-49ef-4baf-8210-ab0ca08a7d48 with Priority: HIGHEST for action port [ 947.166984] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05d32358-32a3-497c-a1f6-14de2057f1b3 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.167234] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.167328] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.167732] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.167822] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05d32358-32a3-497c-a1f6-14de2057f1b3',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.169632] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-05d32358-32a3-497c-a1f6-14de2057f1b3 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.169815] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.169898] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.170323] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.170619] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.170850] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.171052] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.171245] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.171394] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.171552] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05d32358-32a3-497c-a1f6-14de2057f1b3',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.175725] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e2a5ea0-49ef-4baf-8210-ab0ca08a7d48 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.175725] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e2a5ea0-49ef-4baf-8210-ab0ca08a7d48" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.175725] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e2a5ea0-49ef-4baf-8210-ab0ca08a7d48" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.175725] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e2a5ea0-49ef-4baf-8210-ab0ca08a7d48" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.175725] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e2a5ea0-49ef-4baf-8210-ab0ca08a7d48',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.396722] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.397724] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.675062] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05d32358-32a3-497c-a1f6-14de2057f1b3',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.675857] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-05d32358-32a3-497c-a1f6-14de2057f1b3 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.676017] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.676369] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e2a5ea0-49ef-4baf-8210-ab0ca08a7d48 with status ACTIVE [ 947.676539] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.676648] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.676703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.676899] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.676986] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.677165] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.677259] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.677365] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.677473] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.677559] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.677745] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.677839] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.677899] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.678043] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.678119] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.678189] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e2a5ea0-49ef-4baf-8210-ab0ca08a7d48 is going to be updated. [ 947.698670] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.698757] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.698861] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.699537] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.699537] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.699537] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e2a5ea0-49ef-4baf-8210-ab0ca08a7d48" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.855519] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: SUCCESS [ 947.855519] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.855690] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.855876] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.856125] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.856256] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.856321] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.856483] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.856609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.856645] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.856735] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.123671] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21a0bbd4-6f51-4a42-b423-363e65f0247c in Status: SUCCESS [ 948.126159] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.126159] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.126159] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.126159] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.126159] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.126159] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.126159] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.126159] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.126159] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.126159] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21a0bbd4-6f51-4a42-b423-363e65f0247c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.178213] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05d32358-32a3-497c-a1f6-14de2057f1b3',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.359197] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.363164] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.363164] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.363164] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.363164] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.363164] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.363164] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.363164] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.363164] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.363164] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.363164] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.363164] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.363164] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.363164] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.363164] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.364904] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.364904] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.364904] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.364904] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.364904] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.364904] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.443654] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbc55d75-4ce5-409b-958a-48efef735829 in Status: SUCCESS [ 948.444348] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.444688] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.445045] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.445220] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbc55d75-4ce5-409b-958a-48efef735829',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.447661] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6432899c-b0aa-4285-971f-16ac27b1305b in Status: SUCCESS [ 948.447867] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.631103] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21a0bbd4-6f51-4a42-b423-363e65f0247c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.680129] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.680855] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.680925] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.681175] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.688023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.688023] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05d32358-32a3-497c-a1f6-14de2057f1b3 is going to be created. [ 948.707764] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.708308] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.708435] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.708709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.708825] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.724034] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05d32358-32a3-497c-a1f6-14de2057f1b3 in Status: UNINITIALIZED for 2s [ 948.867486] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bbf64d2-1030-46ae-99d0-42b29d7d0132: rpc.has_security_group_logging(os_id): False [ 948.891685] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.891685] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.891685] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.891685] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.891685] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.891685] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.891685] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.891685] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.892147] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.892147] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.896023] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.896023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.896023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.896023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.896023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.896023] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.896023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.896023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.896023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.896023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.896023] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 is going to be updated. [ 948.949223] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc55d75-4ce5-409b-958a-48efef735829 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.949686] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.949807] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.950192] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.950385] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.950712] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.950867] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.951207] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.951261] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.951382] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.951533] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cbc55d75-4ce5-409b-958a-48efef735829',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.985980] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.986521] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.986650] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.986963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.987205] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.007401] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: IN_PROGRESS for 2s [ 949.132337] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21a0bbd4-6f51-4a42-b423-363e65f0247c: rpc.has_security_group_logging(os_id): False [ 949.154478] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.154645] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.154725] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.154971] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.155087] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.155375] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.155494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.155569] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.155748] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.155848] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.155935] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21a0bbd4-6f51-4a42-b423-363e65f0247c is going to be created. [ 949.242634] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.242875] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.242995] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.243350] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.244450] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.260249] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21a0bbd4-6f51-4a42-b423-363e65f0247c in Status: IN_PROGRESS for 2s [ 949.453678] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc55d75-4ce5-409b-958a-48efef735829 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.454072] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.454254] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.454572] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.455236] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.455620] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.455774] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.456056] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.456240] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.456503] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.456774] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc55d75-4ce5-409b-958a-48efef735829 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.458019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.458019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.458019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.458019] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.458019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.458019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.458019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.458019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.458019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.463291] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cbc55d75-4ce5-409b-958a-48efef735829',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.965218] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cbc55d75-4ce5-409b-958a-48efef735829: rpc.has_security_group_logging(os_id): False [ 949.986860] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.987207] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.987353] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.987890] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.987890] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.988154] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.988298] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.988443] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.988853] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.988853] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.989042] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.989411] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.989411] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.989526] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.989581] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.989745] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.989907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.990018] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.990342] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.990415] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.990452] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbc55d75-4ce5-409b-958a-48efef735829 is going to be updated. [ 950.095840] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.096156] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.096304] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.096641] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.096879] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.118813] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbc55d75-4ce5-409b-958a-48efef735829 in Status: IN_PROGRESS for 2s [ 950.736608] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05d32358-32a3-497c-a1f6-14de2057f1b3 in Status: SUCCESS [ 950.736964] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.737129] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.737421] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.737655] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.737831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.737934] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.738164] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.738268] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.738378] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.738493] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('05d32358-32a3-497c-a1f6-14de2057f1b3',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.028657] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: SUCCESS [ 951.028996] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.029362] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.029590] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.029721] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.243530] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-05d32358-32a3-497c-a1f6-14de2057f1b3 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.243703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.243775] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.243974] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.244155] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.244251] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.244311] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.244457] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.244542] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.244626] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.244774] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-05d32358-32a3-497c-a1f6-14de2057f1b3 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.244897] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.244951] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.245059] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.245195] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.245282] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.245341] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.245487] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.245557] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.245638] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.245727] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('05d32358-32a3-497c-a1f6-14de2057f1b3',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.278907] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21a0bbd4-6f51-4a42-b423-363e65f0247c in Status: SUCCESS [ 951.279249] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.426479] env[65783]: INFO networking_nsxv3.common.synchronization [req-0f26a3d0-97c4-47c9-b05b-c924ceb0b163 req-cce81879-3dbb-488f-a6ac-cf8820ee28dd tempest-ServerRescueTestJSONUnderV235-739854739 tempest-ServerRescueTestJSONUnderV235-739854739-project-member] Enqueued Resource ID: cbc55d75-4ce5-409b-958a-48efef735829 with Priority: HIGHEST for action security_group_members [ 951.427388] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc55d75-4ce5-409b-958a-48efef735829 with Priority: HIGHEST for action security_group_members [ 951.427875] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc55d75-4ce5-409b-958a-48efef735829 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.428069] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.428173] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.428464] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.429048] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.429048] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.429048] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.429292] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.429292] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.429404] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbc55d75-4ce5-409b-958a-48efef735829',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.533058] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.533398] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.533398] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.534240] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.534452] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.534555] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.534635] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.534809] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.534961] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.535067] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.535125] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.567786] env[65783]: INFO networking_nsxv3.common.synchronization [req-241b2b70-e0ab-4743-882c-bd91a8f4373b req-c26749f6-44e4-41c2-962a-aef165a8d61d tempest-ListServerFiltersTestJSON-326822078 tempest-ListServerFiltersTestJSON-326822078-project-member] Enqueued Resource ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 with Priority: HIGHEST for action security_group_members [ 951.567786] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 with Priority: HIGHEST for action security_group_members [ 951.568375] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-74220b44-588c-49ac-81cc-e6ac2b7c6024 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.568649] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.568869] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.569167] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.569404] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.569607] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.569774] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.570057] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.570236] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.570409] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.748541] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 05d32358-32a3-497c-a1f6-14de2057f1b3: rpc.has_security_group_logging(os_id): False [ 951.769028] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.771459] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.771459] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.771459] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.771459] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.771459] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.771459] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.771459] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.776027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.776027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.776027] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.776027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.776027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.776027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.776027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.776027] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.776027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.776027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.776027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.776027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.776027] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05d32358-32a3-497c-a1f6-14de2057f1b3 is going to be created. [ 951.838477] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.840496] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.840789] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.841116] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.842478] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.857292] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05d32358-32a3-497c-a1f6-14de2057f1b3 in Status: IN_PROGRESS for 2s [ 951.932583] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.932770] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.932827] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.933134] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.933242] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.933446] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.933580] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.934607] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.934607] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.934607] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.934607] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbc55d75-4ce5-409b-958a-48efef735829 is going to be updated. [ 951.975115] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.975403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.975516] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.975769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.975961] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.986141] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc55d75-4ce5-409b-958a-48efef735829 in Status: IN_PROGRESS for 2s [ 952.039293] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.039455] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.039523] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.039736] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.039912] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.040022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.040091] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.040290] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.040322] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.040413] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.040565] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.040659] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.040717] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.040857] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.040993] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.041953] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.042046] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.042327] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.042327] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.042469] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.042469] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.073518] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.073757] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.073820] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.074306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.098970] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.099522] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.099522] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.099522] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.099762] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.099762] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.099886] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 is going to be updated. [ 952.132211] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.132392] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.132433] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.132766] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.132940] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.134755] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbc55d75-4ce5-409b-958a-48efef735829 in Status: SUCCESS [ 952.135378] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.143789] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 in Status: IN_PROGRESS for 2s [ 952.544983] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bbf64d2-1030-46ae-99d0-42b29d7d0132: rpc.has_security_group_logging(os_id): False [ 952.564481] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.564481] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.564625] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.565331] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.565331] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.565331] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.565331] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.565331] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.565551] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.565551] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.565712] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.565829] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.565889] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.566055] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.566816] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.566816] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.566816] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.566816] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.566816] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.566816] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.566816] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 is going to be updated. [ 952.630254] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.630458] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.630458] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.630669] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.630807] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.649088] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: IN_PROGRESS for 2s [ 953.868604] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05d32358-32a3-497c-a1f6-14de2057f1b3 in Status: SUCCESS [ 953.868935] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.997185] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc55d75-4ce5-409b-958a-48efef735829 in Status: SUCCESS [ 953.997490] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbc55d75-4ce5-409b-958a-48efef735829 deletion is rescheduled due to dependency. [ 953.997490] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.155770] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 in Status: SUCCESS [ 954.155998] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 deletion is rescheduled due to dependency. [ 954.156160] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.668623] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: SUCCESS [ 954.668958] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.224937] env[65783]: INFO networking_nsxv3.common.synchronization [req-9b50d833-847f-442e-9fbf-24ebd083da23 req-bb443336-2648-4758-8b7d-c511e8e606bb tempest-InstanceActionsV221TestJSON-2011935552 tempest-InstanceActionsV221TestJSON-2011935552-project-member] Enqueued Resource ID: 778e25c7-acbe-47ad-a052-4adb2729b152 with Priority: HIGHEST for action security_group_members [ 955.224937] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 778e25c7-acbe-47ad-a052-4adb2729b152 with Priority: HIGHEST for action security_group_members [ 955.224937] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-778e25c7-acbe-47ad-a052-4adb2729b152 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.224937] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.224937] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.224937] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.224937] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.224937] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.224937] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.224937] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.224937] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.225563] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('778e25c7-acbe-47ad-a052-4adb2729b152',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.563919] env[65783]: INFO networking_nsxv3.common.synchronization [req-810acbe6-71d5-4f73-ba4f-fc38c9f5dc89 req-e151acdb-29f7-4182-ab18-a5c0b9c2e832 tempest-ServersTestMultiNic-291669374 tempest-ServersTestMultiNic-291669374-project-member] Enqueued Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 955.563919] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 955.563919] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.565494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.565494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.565494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.565494] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.565494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.565494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.565494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.565813] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.565813] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.656174] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-938 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.656436] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-938" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.656586] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-938" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.656928] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-938" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.657513] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.657698] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.657849] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.658098] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.658245] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.658535] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 955.658653] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 955.658769] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 955.658874] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 955.659010] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 955.659144] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 955.659294] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 955.686725] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 955.686917] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 955.687077] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 955.689623] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-938" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.689623] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-a0e489a6-9195-4339-a917-3486d9f0da45 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.689623] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-a0e489a6-9195-4339-a917-3486d9f0da45" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.689623] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-a0e489a6-9195-4339-a917-3486d9f0da45" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.689623] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-a0e489a6-9195-4339-a917-3486d9f0da45" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.689623] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0e489a6-9195-4339-a917-3486d9f0da45',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.730544] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.730702] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.730776] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.730987] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.731093] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.731282] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.731379] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.731440] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.731591] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.731665] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.731746] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 778e25c7-acbe-47ad-a052-4adb2729b152 already deleted. [ 955.731822] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.899184] env[65783]: INFO networking_nsxv3.common.synchronization [req-810acbe6-71d5-4f73-ba4f-fc38c9f5dc89 req-bf9776f1-0d1a-4bc8-a963-533f0c00bd0f tempest-ServersTestMultiNic-291669374 tempest-ServersTestMultiNic-291669374-project-member] Enqueued Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 955.900155] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 955.900311] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.900381] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.068893] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.191446] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.191770] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.191924] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.192330] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.192506] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.192704] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port a0e489a6-9195-4339-a917-3486d9f0da45 not found, creating... [ 956.193582] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.193840] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.193996] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.194305] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.194465] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.194789] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.194969] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.195101] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.195370] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.195563] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.195713] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: a0e489a6-9195-4339-a917-3486d9f0da45 is going to be created. [ 956.217600] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.217838] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.217972] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.218285] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.218521] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.218783] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-a0e489a6-9195-4339-a917-3486d9f0da45" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.246050] env[65783]: INFO networking_nsxv3.common.synchronization [req-810acbe6-71d5-4f73-ba4f-fc38c9f5dc89 req-dae3330c-0341-47d9-adf2-b86910aecceb tempest-ServersTestMultiNic-291669374 tempest-ServersTestMultiNic-291669374-project-member] Enqueued Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 956.246625] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 956.246912] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.247110] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.574312] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.590309] env[65783]: INFO networking_nsxv3.common.synchronization [req-8a7c09fa-046f-44de-9ec3-d0b026ff51de req-2fa255bb-d78f-49c8-8890-78a60f47a6ed tempest-ServerActionsTestOtherA-298845163 tempest-ServerActionsTestOtherA-298845163-project-member] Enqueued Resource ID: de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb with Priority: HIGHEST for action security_group_members [ 956.591074] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb with Priority: HIGHEST for action security_group_members [ 956.591468] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.591627] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.591667] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.591854] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.592012] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.592623] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.592623] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.592623] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.592623] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.592623] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.972702] env[65783]: INFO networking_nsxv3.common.synchronization [req-9b50d833-847f-442e-9fbf-24ebd083da23 req-8f16f732-9487-4d5f-a465-fc18dbdce698 service nova] Enqueued Resource ID: 778e25c7-acbe-47ad-a052-4adb2729b152 with Priority: HIGHEST for action security_group_rules [ 956.974295] env[65783]: INFO networking_nsxv3.common.synchronization [req-9b50d833-847f-442e-9fbf-24ebd083da23 req-8f16f732-9487-4d5f-a465-fc18dbdce698 service nova] Enqueued Resource ID: 778e25c7-acbe-47ad-a052-4adb2729b152 with Priority: HIGHEST for action security_group_members [ 956.974642] env[65783]: INFO networking_nsxv3.common.synchronization [req-9b50d833-847f-442e-9fbf-24ebd083da23 req-8f16f732-9487-4d5f-a465-fc18dbdce698 service nova] Enqueued Resource ID: a0e489a6-9195-4339-a917-3486d9f0da45 with Priority: HIGHEST for action port [ 956.975867] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 778e25c7-acbe-47ad-a052-4adb2729b152 with Priority: HIGHEST for action security_group_rules [ 956.975867] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 778e25c7-acbe-47ad-a052-4adb2729b152 with Priority: HIGHEST for action security_group_members [ 956.975867] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0e489a6-9195-4339-a917-3486d9f0da45 with Priority: HIGHEST for action port [ 956.975998] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-778e25c7-acbe-47ad-a052-4adb2729b152 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.976123] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.976123] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.977541] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.977541] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('778e25c7-acbe-47ad-a052-4adb2729b152',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.981032] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-778e25c7-acbe-47ad-a052-4adb2729b152 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.981032] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.981032] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.981032] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.981032] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.981032] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.981032] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.981032] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.981032] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.981032] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('778e25c7-acbe-47ad-a052-4adb2729b152',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.982009] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0e489a6-9195-4339-a917-3486d9f0da45 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.982735] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0e489a6-9195-4339-a917-3486d9f0da45" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.982735] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0e489a6-9195-4339-a917-3486d9f0da45" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.982735] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0e489a6-9195-4339-a917-3486d9f0da45" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.982735] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0e489a6-9195-4339-a917-3486d9f0da45',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.079172] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.079354] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.079429] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.079900] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.079900] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.080128] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 is going to be updated. [ 957.095368] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.095985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.095985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.095985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.121129] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.121436] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.121602] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.121675] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.121945] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.122060] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.122154] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb is going to be updated. [ 957.124830] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.125039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.125102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.125500] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.125500] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.139116] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: IN_PROGRESS for 2s [ 957.158488] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.158488] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.158859] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.158928] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.159101] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.170466] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb in Status: IN_PROGRESS for 2s [ 957.485059] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('778e25c7-acbe-47ad-a052-4adb2729b152',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.487707] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-778e25c7-acbe-47ad-a052-4adb2729b152 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.487912] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.488208] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a0e489a6-9195-4339-a917-3486d9f0da45 with status ACTIVE [ 957.488829] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.488829] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.488829] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.489568] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.489568] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.489840] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.489840] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.489925] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.490176] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.490395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.490624] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.490797] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.490915] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.491141] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.491228] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.491348] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a0e489a6-9195-4339-a917-3486d9f0da45 is going to be updated. [ 957.517788] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.517788] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.517788] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.517788] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.518117] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.518117] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0e489a6-9195-4339-a917-3486d9f0da45" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.753818] env[65783]: INFO networking_nsxv3.common.synchronization [req-1a7de155-9e6c-47d8-a3af-d687f969b409 req-ed7de272-6537-40f9-8954-1bd150dd1097 tempest-ImagesTestJSON-433702528 tempest-ImagesTestJSON-433702528-project-member] Enqueued Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 957.754389] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 957.754706] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.754841] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.754901] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.755096] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.755245] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.755340] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.755405] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.755563] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.755651] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.755743] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.988579] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('778e25c7-acbe-47ad-a052-4adb2729b152',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.118837] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-509 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.119240] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-509" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.119516] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-509" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.119972] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-509" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.120411] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.121186] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.121186] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.121344] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.121547] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.121912] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 958.122156] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 958.122403] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 958.122690] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 958.122942] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 958.123178] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 958.123380] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 958.159296] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 958.159500] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 958.159612] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 958.159800] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-509" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.160237] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-f5aec569-cc68-4c71-a4ca-10710acfbd44 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.160494] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-f5aec569-cc68-4c71-a4ca-10710acfbd44" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.160594] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-f5aec569-cc68-4c71-a4ca-10710acfbd44" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.160909] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-f5aec569-cc68-4c71-a4ca-10710acfbd44" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.161062] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5aec569-cc68-4c71-a4ca-10710acfbd44',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.257902] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.258168] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.258230] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.258423] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.258544] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.258710] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.258812] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.258891] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.259044] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.259122] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.259302] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd942bf-b305-4707-8084-1ac6b135c741 is going to be updated. [ 958.289389] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.289389] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.289389] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.289632] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.289632] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.300465] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: IN_PROGRESS for 2s [ 958.491113] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.491417] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.491417] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.491684] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.491796] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.491921] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 778e25c7-acbe-47ad-a052-4adb2729b152 is going to be created. [ 958.524029] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.524312] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.524312] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.524445] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.524604] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.534987] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 778e25c7-acbe-47ad-a052-4adb2729b152 in Status: UNINITIALIZED for 2s [ 958.665168] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.665168] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.665168] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.665168] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.665168] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.665168] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port f5aec569-cc68-4c71-a4ca-10710acfbd44 not found, creating... [ 958.665168] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.665168] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.665168] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.667661] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.668390] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.668390] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.669661] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.669661] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.669661] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.669661] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.669661] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: f5aec569-cc68-4c71-a4ca-10710acfbd44 is going to be created. [ 958.693037] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.693037] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.693037] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.693037] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.693037] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.693037] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-f5aec569-cc68-4c71-a4ca-10710acfbd44" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.149364] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: SUCCESS [ 959.149590] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.149761] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.150432] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.150432] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.150432] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.150687] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.150687] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.150746] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.150851] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.183303] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb in Status: SUCCESS [ 959.183558] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb deletion is rescheduled due to dependency. [ 959.183679] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.408835] env[65783]: INFO networking_nsxv3.common.synchronization [req-1a7de155-9e6c-47d8-a3af-d687f969b409 req-14451a5f-5d6c-4205-9621-2ee2902d83e1 service nova] Enqueued Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_rules [ 959.408835] env[65783]: INFO networking_nsxv3.common.synchronization [req-1a7de155-9e6c-47d8-a3af-d687f969b409 req-14451a5f-5d6c-4205-9621-2ee2902d83e1 service nova] Enqueued Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 959.409078] env[65783]: INFO networking_nsxv3.common.synchronization [req-1a7de155-9e6c-47d8-a3af-d687f969b409 req-14451a5f-5d6c-4205-9621-2ee2902d83e1 service nova] Enqueued Resource ID: f5aec569-cc68-4c71-a4ca-10710acfbd44 with Priority: HIGHEST for action port [ 959.409216] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_rules [ 959.409394] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 959.409441] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5aec569-cc68-4c71-a4ca-10710acfbd44 with Priority: HIGHEST for action port [ 959.410592] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.410737] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.410793] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.411009] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.411100] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.411996] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.411996] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.412240] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5aec569-cc68-4c71-a4ca-10710acfbd44 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.412514] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5aec569-cc68-4c71-a4ca-10710acfbd44" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.412514] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5aec569-cc68-4c71-a4ca-10710acfbd44" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.412614] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5aec569-cc68-4c71-a4ca-10710acfbd44" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.412690] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5aec569-cc68-4c71-a4ca-10710acfbd44',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.657034] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.657034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.657034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.657034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.657034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.657034] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.657034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.657034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.657034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.657034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.657034] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 is going to be updated. [ 959.691515] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.691668] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.691743] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.691963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.692128] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.703498] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: IN_PROGRESS for 2s [ 959.915074] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f5aec569-cc68-4c71-a4ca-10710acfbd44 with status ACTIVE [ 959.915718] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.915718] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.915718] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.915922] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.915954] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.916136] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.916312] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.916312] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.916427] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.916530] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.916718] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.916852] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.916935] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.917061] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.917137] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.917220] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f5aec569-cc68-4c71-a4ca-10710acfbd44 is going to be updated. [ 959.918364] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.918458] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.941089] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.941286] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.941478] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.941643] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.941643] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.942188] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5aec569-cc68-4c71-a4ca-10710acfbd44" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.314756] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: SUCCESS [ 960.315328] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd942bf-b305-4707-8084-1ac6b135c741 deletion is rescheduled due to dependency. [ 960.315328] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.315328] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.315572] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.315787] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.315957] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.316058] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.316534] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.316534] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.316534] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.547764] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 778e25c7-acbe-47ad-a052-4adb2729b152 in Status: SUCCESS [ 960.547764] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.547764] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.547764] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.547764] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.547764] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.547764] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.547764] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.547764] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.547764] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.547764] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('778e25c7-acbe-47ad-a052-4adb2729b152',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.819929] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.050490] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-778e25c7-acbe-47ad-a052-4adb2729b152 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.050732] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.050785] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.051040] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.051601] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.051601] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.051601] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.051601] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.051842] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.051842] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.051901] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-778e25c7-acbe-47ad-a052-4adb2729b152 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.052036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.052036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.052324] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.052484] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.052590] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.052708] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.052872] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.052962] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.053067] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.053168] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('778e25c7-acbe-47ad-a052-4adb2729b152',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.324743] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.555443] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 778e25c7-acbe-47ad-a052-4adb2729b152: rpc.has_security_group_logging(os_id): False [ 961.575199] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.575447] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.575492] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.575725] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.575820] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.576070] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.576188] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.576293] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.576660] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.577027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.577027] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.577277] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.577277] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.577277] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.577399] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.577566] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.577661] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.577719] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.577866] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.577943] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.578069] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 778e25c7-acbe-47ad-a052-4adb2729b152 is going to be created. [ 961.643869] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.644058] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.644119] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.644469] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.644659] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.657223] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 778e25c7-acbe-47ad-a052-4adb2729b152 in Status: IN_PROGRESS for 2s [ 961.713685] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: SUCCESS [ 961.714055] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 deletion is rescheduled due to dependency. [ 961.714236] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.714478] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.714779] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.715072] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.715254] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.715351] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.715600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.715723] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.716502] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.827860] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.828275] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.828275] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.828628] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.828628] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.828628] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd942bf-b305-4707-8084-1ac6b135c741 is going to be updated. [ 961.860453] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.860657] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.860844] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.861207] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.861359] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.871248] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: IN_PROGRESS for 2s [ 962.221028] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.221028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.221028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.221028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.221028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.221028] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.221028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.221028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.221028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.221028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.221028] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 is going to be updated. [ 962.255858] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.256068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.256068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.256303] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.256422] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.267259] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: IN_PROGRESS for 2s [ 963.473639] env[65783]: INFO networking_nsxv3.common.synchronization [req-6607bd8f-eabd-41be-b50c-010db4b40067 req-d781441f-eb35-4b71-901b-b602a115ca9d tempest-ImagesOneServerNegativeTestJSON-1524253690 tempest-ImagesOneServerNegativeTestJSON-1524253690-project-member] Enqueued Resource ID: 6432899c-b0aa-4285-971f-16ac27b1305b with Priority: HIGHEST for action security_group_members [ 963.474342] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6432899c-b0aa-4285-971f-16ac27b1305b with Priority: HIGHEST for action security_group_members [ 963.474685] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-6432899c-b0aa-4285-971f-16ac27b1305b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.474815] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.474927] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.476758] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.476883] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.476974] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.477057] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.477251] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.477339] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.477439] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6432899c-b0aa-4285-971f-16ac27b1305b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.668885] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 778e25c7-acbe-47ad-a052-4adb2729b152 in Status: SUCCESS [ 963.668991] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.882678] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: SUCCESS [ 963.882678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.882678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.882678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.883086] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.883086] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.883086] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.883361] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.883361] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.883496] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.883496] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.981895] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.982197] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.982307] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.982601] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.982773] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.983058] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.983173] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.983256] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.983549] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.983869] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.983869] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6432899c-b0aa-4285-971f-16ac27b1305b is going to be updated. [ 964.015889] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.016123] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.016211] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.016516] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.016713] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.026810] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6432899c-b0aa-4285-971f-16ac27b1305b in Status: IN_PROGRESS for 2s [ 964.279717] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: SUCCESS [ 964.279717] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 deletion is rescheduled due to dependency. [ 964.279717] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.388927] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.388927] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.388927] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.388927] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.388927] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.388927] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.388927] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.388927] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.388927] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.388927] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.388927] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.388927] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.388927] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.388927] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.388927] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.388927] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.389562] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.389562] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.389562] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.389562] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.389562] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.424698] env[65783]: INFO networking_nsxv3.common.synchronization [req-eab74e8d-9b07-4f4d-96f6-94b588c08d13 req-f3f498e7-0af0-4ebf-b3da-396af7f15433 tempest-ServersTestManualDisk-213355435 tempest-ServersTestManualDisk-213355435-project-member] Enqueued Resource ID: 72614839-90ad-4218-8056-d4c6f35d8448 with Priority: HIGHEST for action security_group_members [ 964.424963] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72614839-90ad-4218-8056-d4c6f35d8448 with Priority: HIGHEST for action security_group_members [ 964.425382] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-72614839-90ad-4218-8056-d4c6f35d8448 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.425616] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.425703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.426036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.426209] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.426311] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.426374] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.426528] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.426841] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.426841] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72614839-90ad-4218-8056-d4c6f35d8448',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.836143] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-168 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.836541] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-168" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.836541] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-168" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.836857] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-168" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.837132] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.837292] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.837408] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.837635] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.837799] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.838088] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 964.838307] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 964.838387] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 964.838452] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 964.838577] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 964.838746] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 964.838949] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 964.858288] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 964.858525] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 964.858820] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 964.859090] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-168" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.859508] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-ec66b0ca-3c2b-4ee6-aa95-6b07e9e55c7b taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.859742] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-ec66b0ca-3c2b-4ee6-aa95-6b07e9e55c7b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.859910] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-ec66b0ca-3c2b-4ee6-aa95-6b07e9e55c7b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.860353] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-ec66b0ca-3c2b-4ee6-aa95-6b07e9e55c7b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.860567] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec66b0ca-3c2b-4ee6-aa95-6b07e9e55c7b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.891591] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for efd942bf-b305-4707-8084-1ac6b135c741: rpc.has_security_group_logging(os_id): False [ 964.910195] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.910395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.910395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.910511] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.910618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.910997] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.910997] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.911134] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.911208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.911344] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.911466] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.911557] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.911687] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.911826] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.911962] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.912094] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.912183] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.912239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.912384] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.912455] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.912539] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efd942bf-b305-4707-8084-1ac6b135c741 is going to be updated. [ 964.929492] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.929661] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.929736] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.929957] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.930073] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.930290] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.930387] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.930490] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.930659] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.930738] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.930827] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72614839-90ad-4218-8056-d4c6f35d8448 already deleted. [ 964.930906] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.983957] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.983957] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.983957] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.984210] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.984382] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.022877] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: IN_PROGRESS for 2s [ 965.364466] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.364709] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.364830] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.365235] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.365389] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.365566] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port ec66b0ca-3c2b-4ee6-aa95-6b07e9e55c7b not found, creating... [ 965.365876] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.366305] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.366305] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.366423] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.366582] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.366925] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.367110] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.367269] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.367528] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.367698] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.367866] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: ec66b0ca-3c2b-4ee6-aa95-6b07e9e55c7b is going to be created. [ 965.390530] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.390792] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.390972] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.391271] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.391493] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.391716] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-ec66b0ca-3c2b-4ee6-aa95-6b07e9e55c7b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.042932] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6432899c-b0aa-4285-971f-16ac27b1305b in Status: SUCCESS [ 966.044474] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6432899c-b0aa-4285-971f-16ac27b1305b deletion is rescheduled due to dependency. [ 966.044474] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.195037] env[65783]: INFO networking_nsxv3.common.synchronization [req-eab74e8d-9b07-4f4d-96f6-94b588c08d13 req-62ab643d-b7b5-41bb-a6ca-2f5067096010 service nova] Enqueued Resource ID: 72614839-90ad-4218-8056-d4c6f35d8448 with Priority: HIGHEST for action security_group_rules [ 966.195037] env[65783]: INFO networking_nsxv3.common.synchronization [req-eab74e8d-9b07-4f4d-96f6-94b588c08d13 req-62ab643d-b7b5-41bb-a6ca-2f5067096010 service nova] Enqueued Resource ID: 72614839-90ad-4218-8056-d4c6f35d8448 with Priority: HIGHEST for action security_group_members [ 966.195037] env[65783]: INFO networking_nsxv3.common.synchronization [req-eab74e8d-9b07-4f4d-96f6-94b588c08d13 req-62ab643d-b7b5-41bb-a6ca-2f5067096010 service nova] Enqueued Resource ID: ec66b0ca-3c2b-4ee6-aa95-6b07e9e55c7b with Priority: HIGHEST for action port [ 966.195037] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72614839-90ad-4218-8056-d4c6f35d8448 with Priority: HIGHEST for action security_group_rules [ 966.195037] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72614839-90ad-4218-8056-d4c6f35d8448 with Priority: HIGHEST for action security_group_members [ 966.195037] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec66b0ca-3c2b-4ee6-aa95-6b07e9e55c7b with Priority: HIGHEST for action port [ 966.195537] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72614839-90ad-4218-8056-d4c6f35d8448 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.195796] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.196069] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.196942] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.196942] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72614839-90ad-4218-8056-d4c6f35d8448',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.199424] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-72614839-90ad-4218-8056-d4c6f35d8448 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.199424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.199424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.199424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.199424] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.199424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.199699] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.200077] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.200253] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.200377] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72614839-90ad-4218-8056-d4c6f35d8448',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.201338] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec66b0ca-3c2b-4ee6-aa95-6b07e9e55c7b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.202327] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec66b0ca-3c2b-4ee6-aa95-6b07e9e55c7b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.202327] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec66b0ca-3c2b-4ee6-aa95-6b07e9e55c7b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.202501] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec66b0ca-3c2b-4ee6-aa95-6b07e9e55c7b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.202643] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec66b0ca-3c2b-4ee6-aa95-6b07e9e55c7b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.707496] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72614839-90ad-4218-8056-d4c6f35d8448',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.708420] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-72614839-90ad-4218-8056-d4c6f35d8448 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.708524] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.708797] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ec66b0ca-3c2b-4ee6-aa95-6b07e9e55c7b with status ACTIVE [ 966.708865] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.708929] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.709043] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.709207] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.709295] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.709533] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.710403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.710403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.710403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.710403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.712475] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.712475] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.712475] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.713265] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.713265] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.713265] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ec66b0ca-3c2b-4ee6-aa95-6b07e9e55c7b is going to be updated. [ 966.736022] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.736166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.736255] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.736649] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.736649] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.736762] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec66b0ca-3c2b-4ee6-aa95-6b07e9e55c7b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.040959] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: SUCCESS [ 967.041294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.215667] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72614839-90ad-4218-8056-d4c6f35d8448',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.477461] env[65783]: INFO networking_nsxv3.common.synchronization [req-4a51723d-baba-46fc-b671-5fe6f5053190 req-295be38f-7b17-411a-8e4d-d7e8f785df1b tempest-DeleteServersTestJSON-1456685968 tempest-DeleteServersTestJSON-1456685968-project-member] Enqueued Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 967.478536] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 967.478536] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.478744] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.478744] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.478953] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.479143] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.479274] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.479335] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.479494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.479592] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.479689] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.719935] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.720171] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.720240] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.720452] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.720580] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.720661] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72614839-90ad-4218-8056-d4c6f35d8448 is going to be created. [ 967.753633] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.753633] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.753633] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.753633] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.754378] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.767778] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72614839-90ad-4218-8056-d4c6f35d8448 in Status: UNINITIALIZED for 2s [ 967.983579] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.983970] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.984049] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.984563] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.009174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.009174] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.009174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.009174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.009378] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.009722] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.009722] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 is going to be updated. [ 968.046864] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.047049] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.047049] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.047229] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.047401] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.059218] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: IN_PROGRESS for 2s [ 968.284393] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-131 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.284799] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-131" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.284799] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-131" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.284875] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-131" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.285134] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.285343] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.285429] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.285618] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.285760] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.285973] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 968.286085] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 968.286195] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 968.286303] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 968.286412] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 968.286514] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 968.286644] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 968.319120] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 968.319338] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 968.319413] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 968.319685] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-131" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.320203] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-9fb26674-54b7-46b3-8502-a80cfdfd36aa taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.320346] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-9fb26674-54b7-46b3-8502-a80cfdfd36aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.320453] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-9fb26674-54b7-46b3-8502-a80cfdfd36aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.320974] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-9fb26674-54b7-46b3-8502-a80cfdfd36aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.321243] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fb26674-54b7-46b3-8502-a80cfdfd36aa',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.824309] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.824461] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.824535] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.824766] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.824916] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.825085] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 9fb26674-54b7-46b3-8502-a80cfdfd36aa not found, creating... [ 968.825383] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.825496] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.825618] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.825839] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.825979] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.826297] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.826665] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.828317] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.828669] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.828955] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.829201] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 9fb26674-54b7-46b3-8502-a80cfdfd36aa is going to be created. [ 968.852423] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.852672] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.852996] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.853381] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.853631] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.854089] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-9fb26674-54b7-46b3-8502-a80cfdfd36aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.575933] env[65783]: INFO networking_nsxv3.common.synchronization [req-4a51723d-baba-46fc-b671-5fe6f5053190 req-64fd2621-fc8a-4e69-8745-cad3ea13945d service nova] Enqueued Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_rules [ 969.576256] env[65783]: INFO networking_nsxv3.common.synchronization [req-4a51723d-baba-46fc-b671-5fe6f5053190 req-64fd2621-fc8a-4e69-8745-cad3ea13945d service nova] Enqueued Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 969.576374] env[65783]: INFO networking_nsxv3.common.synchronization [req-4a51723d-baba-46fc-b671-5fe6f5053190 req-64fd2621-fc8a-4e69-8745-cad3ea13945d service nova] Enqueued Resource ID: 9fb26674-54b7-46b3-8502-a80cfdfd36aa with Priority: HIGHEST for action port [ 969.577073] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_rules [ 969.577297] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 969.577438] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fb26674-54b7-46b3-8502-a80cfdfd36aa with Priority: HIGHEST for action port [ 969.577847] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.578010] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.578091] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.578329] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.578412] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.582166] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.582166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.582166] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fb26674-54b7-46b3-8502-a80cfdfd36aa taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.582166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fb26674-54b7-46b3-8502-a80cfdfd36aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.582166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fb26674-54b7-46b3-8502-a80cfdfd36aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.582166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fb26674-54b7-46b3-8502-a80cfdfd36aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.582166] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fb26674-54b7-46b3-8502-a80cfdfd36aa',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.783921] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72614839-90ad-4218-8056-d4c6f35d8448 in Status: SUCCESS [ 969.784125] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.784278] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.784529] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.784756] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.785151] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.785151] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.785255] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.785287] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.785398] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.785859] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72614839-90ad-4218-8056-d4c6f35d8448',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.833137] env[65783]: INFO networking_nsxv3.common.synchronization [req-55e16580-e798-4dfc-8e40-64faa2ff1d1d req-979f29f2-9c38-4023-b64a-a42eb9ebbf38 tempest-InstanceActionsV221TestJSON-2011935552 tempest-InstanceActionsV221TestJSON-2011935552-project-member] Enqueued Resource ID: 778e25c7-acbe-47ad-a052-4adb2729b152 with Priority: HIGHEST for action security_group_members [ 969.833544] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 778e25c7-acbe-47ad-a052-4adb2729b152 with Priority: HIGHEST for action security_group_members [ 969.834367] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-778e25c7-acbe-47ad-a052-4adb2729b152 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.834658] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.834821] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.835133] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.837707] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.837707] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.837707] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.837707] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.837707] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.837707] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('778e25c7-acbe-47ad-a052-4adb2729b152',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.074022] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: SUCCESS [ 970.074022] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 deletion is rescheduled due to dependency. [ 970.074022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.074022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.074022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.074022] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.074022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.074022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.074022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.074022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.074488] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.083112] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.083528] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.086277] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9fb26674-54b7-46b3-8502-a80cfdfd36aa with status ACTIVE [ 970.088354] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.088354] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.088354] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.088354] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.088354] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.088354] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.088354] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.088354] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.088354] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.088354] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.088354] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.088809] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.088809] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.089051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.089051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.089166] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9fb26674-54b7-46b3-8502-a80cfdfd36aa is going to be updated. [ 970.117872] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.117964] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.118322] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.118675] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.118767] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.119426] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fb26674-54b7-46b3-8502-a80cfdfd36aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.261349] env[65783]: INFO networking_nsxv3.common.synchronization [req-752c8886-8264-4cce-a0a4-d6bc4ad7a2c8 req-b3704341-a747-4426-891e-a1f3fe20d77f tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_members [ 970.261995] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_members [ 970.264020] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.265599] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.268070] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.268070] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.268070] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.268070] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.268070] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.268070] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.268070] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.268070] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.288028] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72614839-90ad-4218-8056-d4c6f35d8448',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.339284] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.339487] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.339582] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.339801] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.339905] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.340204] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.340315] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.340380] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.340539] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.340854] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.340854] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 778e25c7-acbe-47ad-a052-4adb2729b152 is going to be updated. [ 970.373654] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.375086] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.375411] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.375715] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.376023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.390031] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 778e25c7-acbe-47ad-a052-4adb2729b152 in Status: IN_PROGRESS for 2s [ 970.577211] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.656317] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-287 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.656551] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-287" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.656609] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-287" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.656905] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-287" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.657195] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.657371] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.657497] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.657782] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.657883] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.658107] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 970.658238] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 970.658345] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 970.658450] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 970.658564] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 970.658665] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 970.658837] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 970.681531] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 970.681531] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 970.681531] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 970.681531] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-287" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.681531] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-5c238645-7548-466b-983b-2ad80497b15e taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.681531] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-5c238645-7548-466b-983b-2ad80497b15e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.681531] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-5c238645-7548-466b-983b-2ad80497b15e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.681531] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-5c238645-7548-466b-983b-2ad80497b15e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.681531] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c238645-7548-466b-983b-2ad80497b15e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.770647] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.792841] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72614839-90ad-4218-8056-d4c6f35d8448: rpc.has_security_group_logging(os_id): False [ 970.814017] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.814017] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.814017] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.814239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.814239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.814416] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.814509] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.814569] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.818026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.818026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.818026] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72614839-90ad-4218-8056-d4c6f35d8448 is going to be created. [ 970.886034] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.886034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.886034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.886034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.886034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.898237] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72614839-90ad-4218-8056-d4c6f35d8448 in Status: IN_PROGRESS for 2s [ 971.080186] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.185753] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.186135] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.186135] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.186669] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.186669] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.186969] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 5c238645-7548-466b-983b-2ad80497b15e not found, creating... [ 971.187362] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.187783] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.187783] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.188604] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.189408] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.189408] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.189408] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.189649] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.189997] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.189997] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.190200] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 5c238645-7548-466b-983b-2ad80497b15e is going to be created. [ 971.215572] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.215768] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.215820] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.216139] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.216371] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.216618] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-5c238645-7548-466b-983b-2ad80497b15e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.274023] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.583545] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.584639] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.584639] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.584639] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.584639] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.584639] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 is going to be updated. [ 971.616993] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.617216] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.617216] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.617817] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.617817] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.626832] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: IN_PROGRESS for 2s [ 971.777988] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.777988] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.777988] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.777988] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.777988] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.777988] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 is going to be updated. [ 971.816408] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.816840] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.816840] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.816959] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.817143] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.828960] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: IN_PROGRESS for 2s [ 972.011103] env[65783]: INFO networking_nsxv3.common.synchronization [req-752c8886-8264-4cce-a0a4-d6bc4ad7a2c8 req-f6573939-5700-4145-bef1-b55fe1fb9aa8 service nova] Enqueued Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_rules [ 972.011379] env[65783]: INFO networking_nsxv3.common.synchronization [req-752c8886-8264-4cce-a0a4-d6bc4ad7a2c8 req-f6573939-5700-4145-bef1-b55fe1fb9aa8 service nova] Enqueued Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_members [ 972.013353] env[65783]: INFO networking_nsxv3.common.synchronization [req-752c8886-8264-4cce-a0a4-d6bc4ad7a2c8 req-f6573939-5700-4145-bef1-b55fe1fb9aa8 service nova] Enqueued Resource ID: 5c238645-7548-466b-983b-2ad80497b15e with Priority: HIGHEST for action port [ 972.013353] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_rules [ 972.013353] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_members [ 972.013353] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c238645-7548-466b-983b-2ad80497b15e with Priority: HIGHEST for action port [ 972.013353] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.013773] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.013773] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.013879] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.014020] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.015988] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.015988] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.016363] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c238645-7548-466b-983b-2ad80497b15e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.016363] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c238645-7548-466b-983b-2ad80497b15e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.016493] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c238645-7548-466b-983b-2ad80497b15e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.017557] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c238645-7548-466b-983b-2ad80497b15e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.017557] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c238645-7548-466b-983b-2ad80497b15e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.139218] env[65783]: INFO networking_nsxv3.common.synchronization [req-2fecc1b9-bf00-405e-bba0-dce79dd76478 req-1471cbbb-3313-4215-b682-d1f03f977024 tempest-ServersV294TestFqdnHostnames-1151149332 tempest-ServersV294TestFqdnHostnames-1151149332-project-member] Enqueued Resource ID: 752cf951-e22b-4bfc-b89a-6766804d295f with Priority: HIGHEST for action security_group_members [ 972.139855] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 752cf951-e22b-4bfc-b89a-6766804d295f with Priority: HIGHEST for action security_group_members [ 972.142304] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-752cf951-e22b-4bfc-b89a-6766804d295f taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.142851] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.142973] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.143257] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.143517] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.143517] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.143517] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.143789] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.143789] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.143873] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('752cf951-e22b-4bfc-b89a-6766804d295f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.407574] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 778e25c7-acbe-47ad-a052-4adb2729b152 in Status: SUCCESS [ 972.407574] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 778e25c7-acbe-47ad-a052-4adb2729b152 deletion is rescheduled due to dependency. [ 972.407720] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.519940] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.520125] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.520320] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5c238645-7548-466b-983b-2ad80497b15e with status ACTIVE [ 972.520498] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.520704] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.520704] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.520990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.521118] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.521298] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.521420] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.521482] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.521655] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.521736] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.522077] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.522174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.522209] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.522380] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.522460] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.522547] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5c238645-7548-466b-983b-2ad80497b15e is going to be updated. [ 972.548143] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.548143] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.548143] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.548445] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.548577] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.548793] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c238645-7548-466b-983b-2ad80497b15e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.646832] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.648039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.648039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.648039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.687370] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.687874] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.688386] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.688386] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.688656] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.688656] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.688721] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 752cf951-e22b-4bfc-b89a-6766804d295f is going to be updated. [ 972.730802] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.730980] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.731054] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.731342] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.731495] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.742866] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 752cf951-e22b-4bfc-b89a-6766804d295f in Status: IN_PROGRESS for 2s [ 972.914062] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72614839-90ad-4218-8056-d4c6f35d8448 in Status: SUCCESS [ 972.914237] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.639914] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: SUCCESS [ 973.640193] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.640442] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.640676] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.640899] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.641089] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.641192] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.641435] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.641480] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.641592] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.641669] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.846542] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: SUCCESS [ 973.846761] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.846761] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.847035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.847238] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.847375] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.847425] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.847619] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.847663] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.847768] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.146789] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.146789] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.146789] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.146789] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.147168] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.147168] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.147168] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.147374] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.147425] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.147529] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.147744] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.147869] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.147929] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.148815] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.148815] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.148815] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.148815] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.148815] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.148815] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.148815] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.149250] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.351067] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.655809] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a56944ee-f571-421e-aac3-fe1ac51a1fd9: rpc.has_security_group_logging(os_id): False [ 974.676562] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.676745] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.679051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.679051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.679051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.679051] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.679051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.679051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.679051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.679051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.679051] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.679051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.679051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.679051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.679051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.679637] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.679637] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.679637] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.679637] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.679784] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.680090] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 is going to be updated. [ 974.755123] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.755123] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.755123] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.755123] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.755123] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.756918] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 752cf951-e22b-4bfc-b89a-6766804d295f in Status: SUCCESS [ 974.757090] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 752cf951-e22b-4bfc-b89a-6766804d295f deletion is rescheduled due to dependency. [ 974.757349] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.772151] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: IN_PROGRESS for 2s [ 974.853192] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.360435] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.360435] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.360435] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.360435] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.360435] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.360435] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 is going to be updated. [ 975.400169] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.400332] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.400401] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.400637] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.400792] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.413777] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: IN_PROGRESS for 2s [ 976.796313] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: SUCCESS [ 976.796313] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.140929] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 977.141151] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 977.427485] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: SUCCESS [ 977.427699] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.427896] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.428133] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.428355] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.428476] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.428535] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.428705] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.428790] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.428879] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.429014] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.932527] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.932979] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.932979] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.933164] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.933278] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.933393] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.933473] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.933645] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.933732] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.933825] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.934065] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.934164] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.934218] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.934359] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.934512] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.934605] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.934660] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.934814] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.934888] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.934959] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.935206] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.441033] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6: rpc.has_security_group_logging(os_id): False [ 978.464779] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.465053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.465185] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.465430] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.465555] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.465758] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.465880] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.465952] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.466151] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.466238] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.466448] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.466653] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.466653] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.466843] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.466899] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.467227] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.467387] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.467460] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.467681] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.467681] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.467786] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 is going to be updated. [ 978.540846] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.541092] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.541092] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.541311] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.541455] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.560221] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: IN_PROGRESS for 2s [ 979.697080] env[65783]: INFO networking_nsxv3.common.synchronization [req-3cc468c3-6929-47fd-be53-fdc3109f35fb req-3c1a212d-8daf-4cad-bea5-52e842ecaca6 tempest-ServerRescueNegativeTestJSON-1644419569 tempest-ServerRescueNegativeTestJSON-1644419569-project-member] Enqueued Resource ID: bbaf974c-75cf-4b48-a666-f75dfe105a74 with Priority: HIGHEST for action security_group_members [ 979.698672] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaf974c-75cf-4b48-a666-f75dfe105a74 with Priority: HIGHEST for action security_group_members [ 979.698672] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbaf974c-75cf-4b48-a666-f75dfe105a74 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.698672] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.698672] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.698882] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.699118] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.699264] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.699578] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.699808] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.700161] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.700299] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbaf974c-75cf-4b48-a666-f75dfe105a74',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.172719] env[65783]: INFO networking_nsxv3.common.synchronization [req-73380b3a-cb0c-4d5d-b778-ba8f35245af2 req-8691c52d-ebff-42ad-91fd-d9acb8229b56 tempest-ImagesTestJSON-433702528 tempest-ImagesTestJSON-433702528-project-member] Enqueued Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 980.172719] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGHEST for action security_group_members [ 980.172719] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.172719] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.173162] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.173162] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.173284] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.173829] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.173829] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.173829] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.173829] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.174075] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.202392] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.202542] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.202601] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.202899] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.226531] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.226531] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.226531] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.226531] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.226531] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.226531] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.226531] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbaf974c-75cf-4b48-a666-f75dfe105a74 is going to be updated. [ 980.255650] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.255852] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.255852] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.256058] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.256252] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.267175] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaf974c-75cf-4b48-a666-f75dfe105a74 in Status: IN_PROGRESS for 2s [ 980.576682] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: SUCCESS [ 980.576921] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.677645] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.677916] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.677916] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.678108] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.678196] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.678417] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.678521] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.678600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.678768] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.678904] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.678938] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd942bf-b305-4707-8084-1ac6b135c741 is going to be updated. [ 980.715131] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.715552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.715552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.715552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.715717] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.725958] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: IN_PROGRESS for 2s [ 981.387364] env[65783]: INFO networking_nsxv3.common.synchronization [req-0d47b4c5-3b91-48b6-a98b-d552c7d9b21a req-8b56dc7a-28cf-44cf-a2ea-8f76392ebfdf tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: d577d0f8-982f-4a86-bc79-bbbf31aff940 with Priority: HIGHEST for action security_group_members [ 981.388474] env[65783]: INFO networking_nsxv3.common.synchronization [req-0d47b4c5-3b91-48b6-a98b-d552c7d9b21a req-8b56dc7a-28cf-44cf-a2ea-8f76392ebfdf tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_members [ 981.388474] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d577d0f8-982f-4a86-bc79-bbbf31aff940 with Priority: HIGHEST for action security_group_members [ 981.388474] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_members [ 981.388474] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-d577d0f8-982f-4a86-bc79-bbbf31aff940 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.389294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.389294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.389294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.389294] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.389294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.389294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.389543] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.389543] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.389635] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d577d0f8-982f-4a86-bc79-bbbf31aff940',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.391735] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.392174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.392174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.392336] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.392336] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.392472] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.392528] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.392640] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.392764] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.392889] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.436555] env[65783]: INFO networking_nsxv3.common.synchronization [req-0d47b4c5-3b91-48b6-a98b-d552c7d9b21a req-8b56dc7a-28cf-44cf-a2ea-8f76392ebfdf tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_rules [ 981.436739] env[65783]: INFO networking_nsxv3.common.synchronization [req-0d47b4c5-3b91-48b6-a98b-d552c7d9b21a req-8b56dc7a-28cf-44cf-a2ea-8f76392ebfdf tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_members [ 981.436875] env[65783]: INFO networking_nsxv3.common.synchronization [req-0d47b4c5-3b91-48b6-a98b-d552c7d9b21a req-8b56dc7a-28cf-44cf-a2ea-8f76392ebfdf tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: d577d0f8-982f-4a86-bc79-bbbf31aff940 with Priority: HIGHEST for action security_group_rules [ 981.437010] env[65783]: INFO networking_nsxv3.common.synchronization [req-0d47b4c5-3b91-48b6-a98b-d552c7d9b21a req-8b56dc7a-28cf-44cf-a2ea-8f76392ebfdf tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: d577d0f8-982f-4a86-bc79-bbbf31aff940 with Priority: HIGHEST for action security_group_members [ 981.437158] env[65783]: INFO networking_nsxv3.common.synchronization [req-0d47b4c5-3b91-48b6-a98b-d552c7d9b21a req-8b56dc7a-28cf-44cf-a2ea-8f76392ebfdf tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: 5c238645-7548-466b-983b-2ad80497b15e with Priority: HIGHEST for action port [ 981.437625] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_rules [ 981.437761] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d577d0f8-982f-4a86-bc79-bbbf31aff940 with Priority: HIGHEST for action security_group_rules [ 981.437858] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c238645-7548-466b-983b-2ad80497b15e with Priority: HIGHEST for action port [ 981.437946] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_members [ 981.438044] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d577d0f8-982f-4a86-bc79-bbbf31aff940 with Priority: HIGHEST for action security_group_members [ 981.438327] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.438440] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.438494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.438694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.438770] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.440393] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d577d0f8-982f-4a86-bc79-bbbf31aff940 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.440393] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.440393] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.440393] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.440393] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d577d0f8-982f-4a86-bc79-bbbf31aff940',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.440792] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c238645-7548-466b-983b-2ad80497b15e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.440908] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c238645-7548-466b-983b-2ad80497b15e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.440942] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c238645-7548-466b-983b-2ad80497b15e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.441097] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c238645-7548-466b-983b-2ad80497b15e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.441168] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c238645-7548-466b-983b-2ad80497b15e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.442623] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.442623] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.442785] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-d577d0f8-982f-4a86-bc79-bbbf31aff940 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.442894] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.859623] env[65783]: INFO networking_nsxv3.common.synchronization [req-387c05f2-aac6-44da-bd8a-af38c30599f9 req-ecdc91bb-ea8c-4257-ad87-02d545209f94 tempest-ServerDiskConfigTestJSON-664757069 tempest-ServerDiskConfigTestJSON-664757069-project-member] Enqueued Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 981.860635] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 981.861181] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.861372] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.861475] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.861757] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.861993] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.862154] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.862247] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.862460] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.862580] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.862716] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.894738] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d577d0f8-982f-4a86-bc79-bbbf31aff940',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.897497] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.944049] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.944219] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.944576] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5c238645-7548-466b-983b-2ad80497b15e with status ACTIVE [ 981.944576] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.944769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.944769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.944951] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.945027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.945231] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.945341] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.945395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.945514] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.945591] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.945907] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.945907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.945907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.946234] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.946234] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.946234] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5c238645-7548-466b-983b-2ad80497b15e is going to be updated. [ 981.947564] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-d577d0f8-982f-4a86-bc79-bbbf31aff940 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.947564] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.968602] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.968788] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.968831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.969069] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.969208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.969369] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c238645-7548-466b-983b-2ad80497b15e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.277351] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbaf974c-75cf-4b48-a666-f75dfe105a74 in Status: SUCCESS [ 982.277660] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbaf974c-75cf-4b48-a666-f75dfe105a74 deletion is rescheduled due to dependency. [ 982.277660] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.366990] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.366990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.366990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.366990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.387487] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.388184] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.388184] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.388184] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.388184] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.388372] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.388579] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 is going to be updated. [ 982.398847] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d577d0f8-982f-4a86-bc79-bbbf31aff940',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.399639] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.417022] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.417206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.417273] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.418014] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.418014] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.432104] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: IN_PROGRESS for 2s [ 982.736317] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd942bf-b305-4707-8084-1ac6b135c741 in Status: SUCCESS [ 982.736525] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd942bf-b305-4707-8084-1ac6b135c741 deletion is rescheduled due to dependency. [ 982.736605] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.902531] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.902945] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.902945] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.903050] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.903188] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.903302] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d577d0f8-982f-4a86-bc79-bbbf31aff940 is going to be created. [ 982.905849] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.905849] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.905849] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.905849] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.905849] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.905849] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 is going to be updated. [ 982.932305] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.932470] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.932551] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.932823] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.933557] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.935784] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.935784] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.935784] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.935979] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.936154] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.943884] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: IN_PROGRESS for 2s [ 982.944736] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d577d0f8-982f-4a86-bc79-bbbf31aff940 in Status: UNINITIALIZED for 2s [ 984.442716] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: SUCCESS [ 984.443041] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 deletion is rescheduled due to dependency. [ 984.443092] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.955230] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d577d0f8-982f-4a86-bc79-bbbf31aff940 in Status: SUCCESS [ 984.956031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.956031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.956436] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.956671] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.956825] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.957086] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.957343] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.957466] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.957649] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d577d0f8-982f-4a86-bc79-bbbf31aff940',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.959743] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: SUCCESS [ 984.959875] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.962112] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.962613] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.962972] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.963185] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.963297] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.963504] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.963615] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.963735] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.465428] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d577d0f8-982f-4a86-bc79-bbbf31aff940',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.466503] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.968448] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d577d0f8-982f-4a86-bc79-bbbf31aff940',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.969369] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.471995] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.472354] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.472354] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.472504] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.472595] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.472719] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d577d0f8-982f-4a86-bc79-bbbf31aff940 is going to be updated. [ 986.474108] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.474235] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.474310] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.474489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.474573] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.474662] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 is going to be updated. [ 986.504610] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.504786] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.505022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.505097] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.505245] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.506941] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.507082] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.507148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.507325] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.507457] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.518747] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d577d0f8-982f-4a86-bc79-bbbf31aff940 in Status: IN_PROGRESS for 2s [ 986.519191] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: IN_PROGRESS for 2s [ 986.861351] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 986.861456] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 987.810637] env[65783]: INFO networking_nsxv3.common.synchronization [req-95e77d67-1a61-4983-b9cf-f36beec141c0 req-6ada7945-ce44-4da0-822e-ce8f49e446df tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_members [ 987.810941] env[65783]: INFO networking_nsxv3.common.synchronization [req-95e77d67-1a61-4983-b9cf-f36beec141c0 req-6ada7945-ce44-4da0-822e-ce8f49e446df tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: d577d0f8-982f-4a86-bc79-bbbf31aff940 with Priority: HIGHEST for action security_group_members [ 987.810992] env[65783]: INFO networking_nsxv3.common.synchronization [req-95e77d67-1a61-4983-b9cf-f36beec141c0 req-6ada7945-ce44-4da0-822e-ce8f49e446df tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: 1ac57a4f-4f62-4224-8157-50ee18687847 with Priority: HIGHEST for action security_group_members [ 987.811514] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_members [ 987.811648] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d577d0f8-982f-4a86-bc79-bbbf31aff940 with Priority: HIGHEST for action security_group_members [ 987.812829] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac57a4f-4f62-4224-8157-50ee18687847 with Priority: HIGHEST for action security_group_members [ 987.812829] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.816251] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.816556] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-d577d0f8-982f-4a86-bc79-bbbf31aff940 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.816645] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.816835] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac57a4f-4f62-4224-8157-50ee18687847 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.816940] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac57a4f-4f62-4224-8157-50ee18687847" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.817020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac57a4f-4f62-4224-8157-50ee18687847" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.817295] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac57a4f-4f62-4224-8157-50ee18687847" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.817448] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.817553] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.817606] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.817770] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.817870] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.817971] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ac57a4f-4f62-4224-8157-50ee18687847',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.860336] env[65783]: INFO networking_nsxv3.common.synchronization [req-95e77d67-1a61-4983-b9cf-f36beec141c0 req-6ada7945-ce44-4da0-822e-ce8f49e446df tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: 1ac57a4f-4f62-4224-8157-50ee18687847 with Priority: HIGHEST for action security_group_rules [ 987.860336] env[65783]: INFO networking_nsxv3.common.synchronization [req-95e77d67-1a61-4983-b9cf-f36beec141c0 req-6ada7945-ce44-4da0-822e-ce8f49e446df tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: 1ac57a4f-4f62-4224-8157-50ee18687847 with Priority: HIGHEST for action security_group_members [ 987.860485] env[65783]: INFO networking_nsxv3.common.synchronization [req-95e77d67-1a61-4983-b9cf-f36beec141c0 req-6ada7945-ce44-4da0-822e-ce8f49e446df tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_rules [ 987.860616] env[65783]: INFO networking_nsxv3.common.synchronization [req-95e77d67-1a61-4983-b9cf-f36beec141c0 req-6ada7945-ce44-4da0-822e-ce8f49e446df tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_members [ 987.861252] env[65783]: INFO networking_nsxv3.common.synchronization [req-95e77d67-1a61-4983-b9cf-f36beec141c0 req-6ada7945-ce44-4da0-822e-ce8f49e446df tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: d577d0f8-982f-4a86-bc79-bbbf31aff940 with Priority: HIGHEST for action security_group_rules [ 987.861252] env[65783]: INFO networking_nsxv3.common.synchronization [req-95e77d67-1a61-4983-b9cf-f36beec141c0 req-6ada7945-ce44-4da0-822e-ce8f49e446df tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: d577d0f8-982f-4a86-bc79-bbbf31aff940 with Priority: HIGHEST for action security_group_members [ 987.861252] env[65783]: INFO networking_nsxv3.common.synchronization [req-95e77d67-1a61-4983-b9cf-f36beec141c0 req-6ada7945-ce44-4da0-822e-ce8f49e446df tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: 5c238645-7548-466b-983b-2ad80497b15e with Priority: HIGHEST for action port [ 987.863552] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac57a4f-4f62-4224-8157-50ee18687847 with Priority: HIGHEST for action security_group_rules [ 987.863706] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_rules [ 987.863823] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d577d0f8-982f-4a86-bc79-bbbf31aff940 with Priority: HIGHEST for action security_group_members [ 987.863914] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c238645-7548-466b-983b-2ad80497b15e with Priority: HIGHEST for action port [ 987.863998] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d577d0f8-982f-4a86-bc79-bbbf31aff940 with Priority: HIGHEST for action security_group_rules [ 987.864322] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac57a4f-4f62-4224-8157-50ee18687847 with Priority: HIGHEST for action security_group_members [ 987.864322] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_members [ 987.864817] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ac57a4f-4f62-4224-8157-50ee18687847 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.864942] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ac57a4f-4f62-4224-8157-50ee18687847" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.865582] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ac57a4f-4f62-4224-8157-50ee18687847" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.865582] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ac57a4f-4f62-4224-8157-50ee18687847" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.865582] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ac57a4f-4f62-4224-8157-50ee18687847',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.866496] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.866688] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.866963] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-d577d0f8-982f-4a86-bc79-bbbf31aff940 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.867072] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.867302] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c238645-7548-466b-983b-2ad80497b15e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.867417] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c238645-7548-466b-983b-2ad80497b15e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.867864] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c238645-7548-466b-983b-2ad80497b15e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.867864] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c238645-7548-466b-983b-2ad80497b15e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.867864] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c238645-7548-466b-983b-2ad80497b15e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.868841] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d577d0f8-982f-4a86-bc79-bbbf31aff940 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.868955] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.869167] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac57a4f-4f62-4224-8157-50ee18687847 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.869250] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac57a4f-4f62-4224-8157-50ee18687847" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.869427] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.869505] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.320967] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ac57a4f-4f62-4224-8157-50ee18687847',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.371623] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac57a4f-4f62-4224-8157-50ee18687847 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.371782] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac57a4f-4f62-4224-8157-50ee18687847" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.371979] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5c238645-7548-466b-983b-2ad80497b15e with status ACTIVE [ 988.372188] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.372305] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.372372] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.372611] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.372706] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.376089] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.376265] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.376353] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.376593] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.376687] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.376943] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.377154] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.377243] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.377438] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.377523] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.377628] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5c238645-7548-466b-983b-2ad80497b15e is going to be updated. [ 988.417775] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.418185] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.418185] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.418762] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.418762] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.418762] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c238645-7548-466b-983b-2ad80497b15e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.423767] env[65783]: INFO networking_nsxv3.common.synchronization [None req-fa4d7772-be0f-4802-a5b1-909ccb11ca7e None None] Enqueued Resource ID: 2c522960-73f1-4663-adb7-2c2724038b9b with Priority: HIGHEST for action port [ 988.425624] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c522960-73f1-4663-adb7-2c2724038b9b with Priority: HIGHEST for action port [ 988.425624] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c522960-73f1-4663-adb7-2c2724038b9b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.425624] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c522960-73f1-4663-adb7-2c2724038b9b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.425624] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c522960-73f1-4663-adb7-2c2724038b9b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.426023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c522960-73f1-4663-adb7-2c2724038b9b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.426103] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c522960-73f1-4663-adb7-2c2724038b9b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.446095] env[65783]: INFO networking_nsxv3.common.synchronization [req-3a8c8ea9-4dfb-47f9-a0c2-92382db676cb req-02d58a93-270f-435c-9f35-290bdb1b949d tempest-ServersTestMultiNic-291669374 tempest-ServersTestMultiNic-291669374-project-member] Enqueued Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 988.446769] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 988.447410] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.447560] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.447701] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.447883] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.448108] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.448251] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.448325] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.448481] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.448557] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.448674] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.537866] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: SUCCESS [ 988.538195] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.538875] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.539183] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.540355] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.540554] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.540665] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.540877] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.541014] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.542913] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.543378] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.545300] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d577d0f8-982f-4a86-bc79-bbbf31aff940 in Status: SUCCESS [ 988.545999] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.546618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.547546] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.547546] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.547546] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.547546] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.547703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.548842] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.548842] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.549127] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.549302] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.550044] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.550169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.550352] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.550490] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.551815] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.551815] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.551815] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d577d0f8-982f-4a86-bc79-bbbf31aff940',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.554653] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.554970] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.555207] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.555329] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.555391] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.555769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.556902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.556902] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d577d0f8-982f-4a86-bc79-bbbf31aff940',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.828681] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ac57a4f-4f62-4224-8157-50ee18687847',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.836443] env[65783]: INFO networking_nsxv3.common.synchronization [req-3a8c8ea9-4dfb-47f9-a0c2-92382db676cb req-3fb3500d-5d37-4209-952e-9e23ec18468a tempest-ServersTestMultiNic-291669374 tempest-ServersTestMultiNic-291669374-project-member] Enqueued Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 988.837616] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 988.838049] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.838193] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.929384] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2c522960-73f1-4663-adb7-2c2724038b9b [ 988.929975] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.930218] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.930218] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.930447] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.930538] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.930600] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2c522960-73f1-4663-adb7-2c2724038b9b already deleted. [ 988.930665] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c522960-73f1-4663-adb7-2c2724038b9b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.953260] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.953419] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.953540] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.953738] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.953795] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.954386] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.954520] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.954589] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.954808] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.954899] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.954988] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 is going to be updated. [ 988.985916] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.986089] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.986161] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.986379] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.986525] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.997812] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: IN_PROGRESS for 2s [ 989.055305] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d577d0f8-982f-4a86-bc79-bbbf31aff940',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.057456] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.057456] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.057744] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.061459] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d577d0f8-982f-4a86-bc79-bbbf31aff940',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.254276] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-953 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.254539] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-953" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.254633] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-953" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.254979] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-953" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.255463] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.255463] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.255591] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.255836] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.256047] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.256302] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 989.256423] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 989.256533] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 989.256727] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 989.256854] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 989.256969] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 989.257125] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 989.285021] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 989.285021] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 989.285617] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 989.285617] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-953" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.285734] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-e5413129-8bf0-444f-9791-900f8e5c2f6e taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.285830] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-e5413129-8bf0-444f-9791-900f8e5c2f6e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.286863] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-e5413129-8bf0-444f-9791-900f8e5c2f6e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.286863] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-e5413129-8bf0-444f-9791-900f8e5c2f6e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.286863] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5413129-8bf0-444f-9791-900f8e5c2f6e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.331036] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.331036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.331239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.331418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.331553] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.332051] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac57a4f-4f62-4224-8157-50ee18687847 is going to be created. [ 989.358438] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.359666] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.359769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.359976] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.360617] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.375776] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac57a4f-4f62-4224-8157-50ee18687847 in Status: UNINITIALIZED for 2s [ 989.559993] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d577d0f8-982f-4a86-bc79-bbbf31aff940: rpc.has_security_group_logging(os_id): False [ 989.561561] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.563745] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d577d0f8-982f-4a86-bc79-bbbf31aff940',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.582790] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.583026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.583118] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.583358] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.583450] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.583674] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.583791] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.583885] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.584095] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.584219] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.584325] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d577d0f8-982f-4a86-bc79-bbbf31aff940 is going to be created. [ 989.640555] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.640861] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.640861] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.640964] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.641207] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.654335] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d577d0f8-982f-4a86-bc79-bbbf31aff940 in Status: IN_PROGRESS for 2s [ 989.794023] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.794023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.794023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.794023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.794023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.794023] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port e5413129-8bf0-444f-9791-900f8e5c2f6e not found, creating... [ 989.794023] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.794023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.794023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.794023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.794023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.794720] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.795215] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.795539] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.795895] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.796299] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.796574] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: e5413129-8bf0-444f-9791-900f8e5c2f6e is going to be created. [ 989.821292] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.821292] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.821292] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.821561] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.821734] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.822055] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-e5413129-8bf0-444f-9791-900f8e5c2f6e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.064330] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.064330] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.064804] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.064804] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.064804] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.064804] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 is going to be updated. [ 990.067702] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.067910] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.067910] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.068092] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.068183] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.068277] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d577d0f8-982f-4a86-bc79-bbbf31aff940 is going to be updated. [ 990.109923] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.109923] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.109923] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.110332] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.110332] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.112185] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.112330] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.112398] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.112543] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.112665] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.125830] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: IN_PROGRESS for 2s [ 990.126444] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d577d0f8-982f-4a86-bc79-bbbf31aff940 in Status: IN_PROGRESS for 2s [ 990.565486] env[65783]: INFO networking_nsxv3.common.synchronization [req-3a8c8ea9-4dfb-47f9-a0c2-92382db676cb req-1cd488c8-5061-437b-bb7e-fd1d31b216f2 service nova] Enqueued Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_rules [ 990.565720] env[65783]: INFO networking_nsxv3.common.synchronization [req-3a8c8ea9-4dfb-47f9-a0c2-92382db676cb req-1cd488c8-5061-437b-bb7e-fd1d31b216f2 service nova] Enqueued Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 990.565789] env[65783]: INFO networking_nsxv3.common.synchronization [req-3a8c8ea9-4dfb-47f9-a0c2-92382db676cb req-1cd488c8-5061-437b-bb7e-fd1d31b216f2 service nova] Enqueued Resource ID: e5413129-8bf0-444f-9791-900f8e5c2f6e with Priority: HIGHEST for action port [ 990.566363] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_rules [ 990.566510] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 990.566600] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5413129-8bf0-444f-9791-900f8e5c2f6e with Priority: HIGHEST for action port [ 990.566879] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.567064] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.567064] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.567364] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.567414] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.568332] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.568431] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.568622] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5413129-8bf0-444f-9791-900f8e5c2f6e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.568731] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5413129-8bf0-444f-9791-900f8e5c2f6e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.568790] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5413129-8bf0-444f-9791-900f8e5c2f6e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.568951] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5413129-8bf0-444f-9791-900f8e5c2f6e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.569039] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5413129-8bf0-444f-9791-900f8e5c2f6e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.178385] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: SUCCESS [ 991.178834] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 deletion is rescheduled due to dependency. [ 991.178834] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.179096] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.179209] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.179305] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.179519] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.179694] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.179799] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.179889] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.180058] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.180138] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.180231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.180322] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.181676] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e5413129-8bf0-444f-9791-900f8e5c2f6e with status ACTIVE [ 991.181869] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.182130] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.182236] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.182407] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.184325] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.184325] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.184325] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.184325] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.184325] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.184325] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.184325] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.184325] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.184325] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.184325] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.184325] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.184325] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e5413129-8bf0-444f-9791-900f8e5c2f6e is going to be updated. [ 991.186083] env[65783]: INFO networking_nsxv3.common.synchronization [req-ee50d427-ab46-437d-a0f0-ea4239868bdc req-7b26c80c-cc40-454d-a524-c946567bef95 tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: 1ac57a4f-4f62-4224-8157-50ee18687847 with Priority: HIGHEST for action security_group_members [ 991.186244] env[65783]: INFO networking_nsxv3.common.synchronization [req-ee50d427-ab46-437d-a0f0-ea4239868bdc req-7b26c80c-cc40-454d-a524-c946567bef95 tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: d577d0f8-982f-4a86-bc79-bbbf31aff940 with Priority: HIGHEST for action security_group_members [ 991.186418] env[65783]: INFO networking_nsxv3.common.synchronization [req-ee50d427-ab46-437d-a0f0-ea4239868bdc req-7b26c80c-cc40-454d-a524-c946567bef95 tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_members [ 991.187723] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.187944] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.188113] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.188210] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.188277] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.188423] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.188503] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.188590] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.189997] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ac57a4f-4f62-4224-8157-50ee18687847 with Priority: HIGHEST for action security_group_members [ 991.190135] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d577d0f8-982f-4a86-bc79-bbbf31aff940 with Priority: HIGHEST for action security_group_members [ 991.190229] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_members [ 991.194684] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ac57a4f-4f62-4224-8157-50ee18687847 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.194825] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ac57a4f-4f62-4224-8157-50ee18687847" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.194985] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-d577d0f8-982f-4a86-bc79-bbbf31aff940 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.195080] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.195258] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.195396] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.216975] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.217224] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.217336] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.217603] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.217776] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.218016] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5413129-8bf0-444f-9791-900f8e5c2f6e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.389028] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-699 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.389028] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-699" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.389028] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-699" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.389028] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-699" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.389028] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.389028] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.389028] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.389028] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.389028] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.389859] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 991.390119] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 991.390329] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 991.390522] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 991.390851] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 991.391098] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 991.391402] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 991.393244] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ac57a4f-4f62-4224-8157-50ee18687847 in Status: SUCCESS [ 991.393583] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac57a4f-4f62-4224-8157-50ee18687847" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.394228] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac57a4f-4f62-4224-8157-50ee18687847" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.394556] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac57a4f-4f62-4224-8157-50ee18687847" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.394836] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.397296] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.397296] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.397296] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.397296] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.397296] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ac57a4f-4f62-4224-8157-50ee18687847',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.417970] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 991.417970] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 991.418303] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 991.419121] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-699" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.419121] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-7b27f93c-6a27-456b-b3aa-04d0cc66c075 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.419336] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-7b27f93c-6a27-456b-b3aa-04d0cc66c075" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.419486] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-7b27f93c-6a27-456b-b3aa-04d0cc66c075" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.419932] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-7b27f93c-6a27-456b-b3aa-04d0cc66c075" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.420105] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b27f93c-6a27-456b-b3aa-04d0cc66c075',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.658602] env[65783]: INFO networking_nsxv3.common.synchronization [req-0edb005d-580a-4c37-8589-749a91c0a934 req-9eb348db-02cf-439f-b754-d4a86f533453 tempest-ServerActionsTestOtherA-298845163 tempest-ServerActionsTestOtherA-298845163-project-member] Enqueued Resource ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 with Priority: HIGHEST for action security_group_members [ 991.659200] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 with Priority: HIGHEST for action security_group_members [ 991.659934] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.660091] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.660151] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.660340] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.660486] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.660576] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.660632] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.660798] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.660965] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.661044] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6dc57fb-f44d-4b26-87fe-bb8e4df202a8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.675039] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d577d0f8-982f-4a86-bc79-bbbf31aff940 in Status: SUCCESS [ 991.675039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.675137] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.675282] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.675387] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d577d0f8-982f-4a86-bc79-bbbf31aff940',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.682213] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.682337] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.691503] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.696327] env[65783]: INFO networking_nsxv3.common.synchronization [None req-ee7274f2-ea8a-44f9-bdf5-1370ba2198bd None None] Enqueued Resource ID: 761cd6d6-e9f4-47d0-a7b7-ab0d96e3766e with Priority: HIGHEST for action port [ 991.696578] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 761cd6d6-e9f4-47d0-a7b7-ab0d96e3766e with Priority: HIGHEST for action port [ 991.697532] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-761cd6d6-e9f4-47d0-a7b7-ab0d96e3766e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.697659] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-761cd6d6-e9f4-47d0-a7b7-ab0d96e3766e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.697726] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-761cd6d6-e9f4-47d0-a7b7-ab0d96e3766e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.698190] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-761cd6d6-e9f4-47d0-a7b7-ab0d96e3766e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.698190] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('761cd6d6-e9f4-47d0-a7b7-ab0d96e3766e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.902930] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.902930] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.902930] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.903379] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.903379] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.903499] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.903563] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.903761] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.903823] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.903882] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.903978] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac57a4f-4f62-4224-8157-50ee18687847 is going to be deleted. [ 991.923675] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.923987] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.924819] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.925365] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.925631] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.925843] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 7b27f93c-6a27-456b-b3aa-04d0cc66c075 not found, creating... [ 991.926381] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.926461] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.926552] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.926994] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.927149] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.927512] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.927937] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.927937] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.928275] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.928497] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.928677] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 7b27f93c-6a27-456b-b3aa-04d0cc66c075 is going to be created. [ 991.954554] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.955492] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.955492] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.957011] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.957181] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.957426] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-7b27f93c-6a27-456b-b3aa-04d0cc66c075" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.959307] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.959307] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.959516] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.959929] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.959929] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.959929] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac57a4f-4f62-4224-8157-50ee18687847" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.961036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac57a4f-4f62-4224-8157-50ee18687847" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.961036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac57a4f-4f62-4224-8157-50ee18687847" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.961036] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.961036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.961036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.961036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.961405] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.961405] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ac57a4f-4f62-4224-8157-50ee18687847',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.044578] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-678 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.044853] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-678" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.045171] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-678" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.045569] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-678" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.045925] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.046128] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.046290] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.046592] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.046776] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.047059] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 992.047237] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 992.047324] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 992.047469] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 992.047618] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 992.047745] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 992.047921] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 992.072479] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 992.072816] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 992.073537] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 992.073537] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-678" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.073537] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-9f372d9b-f11d-40fc-b795-bae66f4a1800 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.073822] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-9f372d9b-f11d-40fc-b795-bae66f4a1800" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.073909] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-9f372d9b-f11d-40fc-b795-bae66f4a1800" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.074261] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-9f372d9b-f11d-40fc-b795-bae66f4a1800" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.074911] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f372d9b-f11d-40fc-b795-bae66f4a1800',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.138785] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: SUCCESS [ 992.139077] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.139950] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d577d0f8-982f-4a86-bc79-bbbf31aff940 in Status: SUCCESS [ 992.140496] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.140496] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.140633] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.140761] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.140879] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.140951] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.141185] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.141271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.141379] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.142296] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.142480] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.143161] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.143161] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.143161] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.143161] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.143161] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.143161] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d577d0f8-982f-4a86-bc79-bbbf31aff940',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.163606] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.163824] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.164356] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.164356] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.188840] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.189312] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.189312] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.189312] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.189513] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.189677] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.189886] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 is going to be updated. [ 992.193947] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.200539] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.202150] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.202388] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.202462] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.202539] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.203348] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d577d0f8-982f-4a86-bc79-bbbf31aff940 is going to be deleted. [ 992.203804] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 761cd6d6-e9f4-47d0-a7b7-ab0d96e3766e [ 992.204102] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.204275] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.204365] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.204579] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.204644] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.204737] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:761cd6d6-e9f4-47d0-a7b7-ab0d96e3766e already deleted. [ 992.204810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-761cd6d6-e9f4-47d0-a7b7-ab0d96e3766e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.220544] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.220779] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.220941] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.221193] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.221360] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.234467] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 in Status: IN_PROGRESS for 2s [ 992.298524] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.298734] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.298875] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.299060] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.299168] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.299323] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.464515] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.464752] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.464860] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.465211] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.465363] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.465703] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.465897] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.466025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.466358] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.466544] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.466717] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac57a4f-4f62-4224-8157-50ee18687847 already deleted. [ 992.467021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac57a4f-4f62-4224-8157-50ee18687847" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.467350] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ac57a4f-4f62-4224-8157-50ee18687847',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.468416] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ac57a4f-4f62-4224-8157-50ee18687847" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.468628] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ac57a4f-4f62-4224-8157-50ee18687847" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.468823] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.468933] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.468991] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.469174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.469245] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.469372] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ac57a4f-4f62-4224-8157-50ee18687847',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.577795] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.577795] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.578055] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.578142] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.578300] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.578496] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 9f372d9b-f11d-40fc-b795-bae66f4a1800 not found, creating... [ 992.578841] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.579027] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.579335] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.579731] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.579731] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.579798] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.579988] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.582737] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.583082] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.583261] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.583417] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 9f372d9b-f11d-40fc-b795-bae66f4a1800 is going to be created. [ 992.612794] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.613119] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.613253] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.613608] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.613870] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.614141] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-9f372d9b-f11d-40fc-b795-bae66f4a1800" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.645328] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.646462] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.646605] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.646733] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.646890] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.647035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.647176] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.647278] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.647335] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.647531] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.647654] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.647742] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d577d0f8-982f-4a86-bc79-bbbf31aff940 is going to be deleted. [ 992.679807] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.680008] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.680090] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.680292] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.680421] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.680885] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.681141] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.681336] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.681514] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.681618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.681679] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.682027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.682027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.682027] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d577d0f8-982f-4a86-bc79-bbbf31aff940',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.696580] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.696805] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.696805] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.697038] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.697134] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.697264] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 is going to be updated. [ 992.704686] env[65783]: INFO networking_nsxv3.common.synchronization [req-3a8c8ea9-4dfb-47f9-a0c2-92382db676cb req-46531863-0d5d-4b97-9986-f63ed810d2e6 service nova] Enqueued Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_rules [ 992.704873] env[65783]: INFO networking_nsxv3.common.synchronization [req-3a8c8ea9-4dfb-47f9-a0c2-92382db676cb req-46531863-0d5d-4b97-9986-f63ed810d2e6 service nova] Enqueued Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 992.705079] env[65783]: INFO networking_nsxv3.common.synchronization [req-3a8c8ea9-4dfb-47f9-a0c2-92382db676cb req-46531863-0d5d-4b97-9986-f63ed810d2e6 service nova] Enqueued Resource ID: 7b27f93c-6a27-456b-b3aa-04d0cc66c075 with Priority: HIGHEST for action port [ 992.705648] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_rules [ 992.705788] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 992.705884] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b27f93c-6a27-456b-b3aa-04d0cc66c075 with Priority: HIGHEST for action port [ 992.706183] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.706285] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.706480] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.706591] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.706729] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b27f93c-6a27-456b-b3aa-04d0cc66c075 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.706857] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b27f93c-6a27-456b-b3aa-04d0cc66c075" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.706913] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b27f93c-6a27-456b-b3aa-04d0cc66c075" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.707100] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b27f93c-6a27-456b-b3aa-04d0cc66c075" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.707249] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b27f93c-6a27-456b-b3aa-04d0cc66c075',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.746372] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.746598] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.746677] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.747030] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.747274] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.758050] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: IN_PROGRESS for 2s [ 992.972663] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.972913] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.973063] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.973220] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.973308] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.973540] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.973647] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.973699] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.973853] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.973924] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.974017] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ac57a4f-4f62-4224-8157-50ee18687847 already deleted. [ 992.974124] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ac57a4f-4f62-4224-8157-50ee18687847" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.974329] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ac57a4f-4f62-4224-8157-50ee18687847',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.150830] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.183927] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.184151] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.184252] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.184415] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.184516] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.184766] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.184852] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.184895] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.185054] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.185134] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.185253] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d577d0f8-982f-4a86-bc79-bbbf31aff940 already deleted. [ 993.185377] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d577d0f8-982f-4a86-bc79-bbbf31aff940" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.209765] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7b27f93c-6a27-456b-b3aa-04d0cc66c075 with status ACTIVE [ 993.210144] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.210213] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.210213] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.210469] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.210600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.210856] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.210973] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.211050] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.211227] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.211319] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.211528] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.211621] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.211674] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.211818] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.211892] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.211977] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7b27f93c-6a27-456b-b3aa-04d0cc66c075 is going to be updated. [ 993.259609] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.259836] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.259907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.260171] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.260348] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.260564] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b27f93c-6a27-456b-b3aa-04d0cc66c075" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.306760] env[65783]: INFO networking_nsxv3.common.synchronization [req-0edb005d-580a-4c37-8589-749a91c0a934 req-f1f5cca2-a455-4434-8793-9ed2a293a04c service nova] Enqueued Resource ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 with Priority: HIGHEST for action security_group_rules [ 993.307124] env[65783]: INFO networking_nsxv3.common.synchronization [req-0edb005d-580a-4c37-8589-749a91c0a934 req-f1f5cca2-a455-4434-8793-9ed2a293a04c service nova] Enqueued Resource ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 with Priority: HIGHEST for action security_group_members [ 993.307548] env[65783]: INFO networking_nsxv3.common.synchronization [req-0edb005d-580a-4c37-8589-749a91c0a934 req-f1f5cca2-a455-4434-8793-9ed2a293a04c service nova] Enqueued Resource ID: 9f372d9b-f11d-40fc-b795-bae66f4a1800 with Priority: HIGHEST for action port [ 993.308436] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 with Priority: HIGHEST for action security_group_rules [ 993.308672] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 with Priority: HIGHEST for action security_group_members [ 993.308858] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f372d9b-f11d-40fc-b795-bae66f4a1800 with Priority: HIGHEST for action port [ 993.309356] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.309547] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.309674] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.310028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.310196] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6dc57fb-f44d-4b26-87fe-bb8e4df202a8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.312401] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.312945] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.313432] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f372d9b-f11d-40fc-b795-bae66f4a1800 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.313554] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f372d9b-f11d-40fc-b795-bae66f4a1800" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.313739] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f372d9b-f11d-40fc-b795-bae66f4a1800" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.314086] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f372d9b-f11d-40fc-b795-bae66f4a1800" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.314242] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f372d9b-f11d-40fc-b795-bae66f4a1800',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.476986] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ac57a4f-4f62-4224-8157-50ee18687847: rpc.has_security_group_logging(os_id): False [ 993.496368] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.496607] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.496660] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.496907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.497040] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.497352] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.497465] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.497551] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.497762] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.497851] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.497966] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ac57a4f-4f62-4224-8157-50ee18687847 is going to be created. [ 993.516921] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/1ac57a4f-4f62-4224-8157-50ee18687847], does not exist path=[/infra/domains/default/groups/1ac57a4f-4f62-4224-8157-50ee18687847]."\n}' [ 993.517171] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ac57a4f-4f62-4224-8157-50ee18687847 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1ac57a4f-4f62-4224-8157-50ee18687847 [ 993.517289] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 993.563290] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.563456] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.563499] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.564185] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.565422] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.565911] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.565911] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.566131] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.566224] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.566327] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.566528] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.566645] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.566683] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.566866] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.566944] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.567106] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ac57a4f-4f62-4224-8157-50ee18687847 is going to be created. [ 993.586142] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/1ac57a4f-4f62-4224-8157-50ee18687847], does not exist path=[/infra/domains/default/groups/1ac57a4f-4f62-4224-8157-50ee18687847]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1ac57a4f-4f62-4224-8157-50ee18687847 [ 993.586414] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ac57a4f-4f62-4224-8157-50ee18687847" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.586613] env[65783]: Traceback (most recent call last): [ 993.586688] env[65783]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 993.586688] env[65783]: return func(*args, **kwargs) [ 993.586688] env[65783]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 993.586688] env[65783]: res.raise_for_status() [ 993.586688] env[65783]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 993.586688] env[65783]: raise HTTPError(http_error_msg, response=self) [ 993.586688] env[65783]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1ac57a4f-4f62-4224-8157-50ee18687847 [ 993.586688] env[65783]: During handling of the above exception, another exception occurred: [ 993.586688] env[65783]: Traceback (most recent call last): [ 993.586688] env[65783]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 993.586688] env[65783]: listener.cb(fileno) [ 993.586688] env[65783]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 993.586688] env[65783]: result = function(*args, **kwargs) [ 993.586688] env[65783]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 993.586688] env[65783]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 993.586688] env[65783]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 993.586688] env[65783]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 993.586688] env[65783]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 993.586688] env[65783]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 993.586688] env[65783]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 993.586688] env[65783]: res.raise_for_status() [ 993.586688] env[65783]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 993.586688] env[65783]: raise HTTPError(http_error_msg, response=self) [ 993.586688] env[65783]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1ac57a4f-4f62-4224-8157-50ee18687847 [ 993.586688] env[65783]: Removing descriptor: 65 [ 993.654143] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.654320] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.654381] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.654594] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.654668] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.654785] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 is going to be updated. [ 993.683996] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.684237] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.684237] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.684437] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.684602] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.695637] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: IN_PROGRESS for 2s [ 993.816967] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.816967] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.817157] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f372d9b-f11d-40fc-b795-bae66f4a1800 with status ACTIVE [ 993.817275] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.817386] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.817451] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.817672] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.818219] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.818219] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.818219] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.818403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.818473] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.818549] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.818761] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.818857] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.818917] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.819084] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.819170] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.819444] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f372d9b-f11d-40fc-b795-bae66f4a1800 is going to be updated. [ 993.842882] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.843092] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.843200] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.843395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.843521] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.843696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f372d9b-f11d-40fc-b795-bae66f4a1800" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.152281] env[65783]: INFO networking_nsxv3.common.synchronization [req-10a9758d-3b28-4353-81cc-9c960a1fa219 req-f4e9d36c-b1aa-4e40-901c-8464d843e664 tempest-ImagesOneServerNegativeTestJSON-1524253690 tempest-ImagesOneServerNegativeTestJSON-1524253690-project-member] Enqueued Resource ID: 6432899c-b0aa-4285-971f-16ac27b1305b with Priority: HIGHEST for action security_group_members [ 994.153106] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6432899c-b0aa-4285-971f-16ac27b1305b with Priority: HIGHEST for action security_group_members [ 994.153517] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-6432899c-b0aa-4285-971f-16ac27b1305b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.153703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.153765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.154110] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.154260] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.154390] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.154473] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.154668] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.154778] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.154912] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6432899c-b0aa-4285-971f-16ac27b1305b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.246797] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 in Status: SUCCESS [ 994.247197] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 deletion is rescheduled due to dependency. [ 994.247197] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.247438] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.247565] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.247750] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.247880] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.247940] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.248105] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.248186] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.248280] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6dc57fb-f44d-4b26-87fe-bb8e4df202a8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.521420] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-169 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.521631] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-169" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.521749] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-169" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.522032] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-169" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.522308] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.522645] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.522796] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.523085] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.523231] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.523438] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 994.523548] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 994.523652] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 994.523754] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 994.523899] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 994.524063] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 994.524236] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 994.545711] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 994.546434] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 994.546434] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 994.546434] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-169" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.546733] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-20da233d-2947-43a6-88b1-229b364fbd48 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.546974] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-20da233d-2947-43a6-88b1-229b364fbd48" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.547144] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-20da233d-2947-43a6-88b1-229b364fbd48" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.547550] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-20da233d-2947-43a6-88b1-229b364fbd48" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.547721] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20da233d-2947-43a6-88b1-229b364fbd48',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.663503] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.663707] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.663813] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.664062] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.685336] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.685667] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.685744] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.685847] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.686064] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.686154] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.686345] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6432899c-b0aa-4285-971f-16ac27b1305b is going to be updated. [ 994.710247] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.710381] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.710381] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.711086] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.711086] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.721498] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6432899c-b0aa-4285-971f-16ac27b1305b in Status: IN_PROGRESS for 2s [ 994.751461] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6dc57fb-f44d-4b26-87fe-bb8e4df202a8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.770748] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: SUCCESS [ 994.770748] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.770748] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.770748] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.770748] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.770748] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.770748] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.770748] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.770748] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.770748] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.052301] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.052301] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.052301] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.052301] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.052561] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.052599] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 20da233d-2947-43a6-88b1-229b364fbd48 not found, creating... [ 995.053679] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.053679] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.053859] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.053993] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.054186] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.054499] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.054696] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.054843] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.055271] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.055466] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.056035] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 20da233d-2947-43a6-88b1-229b364fbd48 is going to be created. [ 995.080206] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.080206] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.080206] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.080206] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.080206] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.080206] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-20da233d-2947-43a6-88b1-229b364fbd48" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.254499] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6dc57fb-f44d-4b26-87fe-bb8e4df202a8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.272493] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.708937] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: SUCCESS [ 995.708937] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.708937] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.708937] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.709191] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.709191] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.709287] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.709416] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.709506] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.709601] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.709842] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.709842] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.709958] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.710049] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.710366] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.710366] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.710639] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.710639] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.710639] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.710766] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.710798] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.711790] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.711861] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.712110] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.712110] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.714580] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.715467] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.715467] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.715560] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.757550] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.757729] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.757805] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.758115] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.758276] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.758347] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 is going to be updated. [ 995.776207] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.790236] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.790380] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.790493] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.790643] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.790788] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.801292] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 in Status: IN_PROGRESS for 2s [ 995.828167] env[65783]: INFO networking_nsxv3.common.synchronization [req-10a9758d-3b28-4353-81cc-9c960a1fa219 req-04381d15-a4e6-4cd7-8a8d-24b69630fe26 service nova] Enqueued Resource ID: 6432899c-b0aa-4285-971f-16ac27b1305b with Priority: HIGHEST for action security_group_rules [ 995.828167] env[65783]: INFO networking_nsxv3.common.synchronization [req-10a9758d-3b28-4353-81cc-9c960a1fa219 req-04381d15-a4e6-4cd7-8a8d-24b69630fe26 service nova] Enqueued Resource ID: 6432899c-b0aa-4285-971f-16ac27b1305b with Priority: HIGHEST for action security_group_members [ 995.828167] env[65783]: INFO networking_nsxv3.common.synchronization [req-10a9758d-3b28-4353-81cc-9c960a1fa219 req-04381d15-a4e6-4cd7-8a8d-24b69630fe26 service nova] Enqueued Resource ID: 20da233d-2947-43a6-88b1-229b364fbd48 with Priority: HIGHEST for action port [ 995.828167] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6432899c-b0aa-4285-971f-16ac27b1305b with Priority: HIGHEST for action security_group_rules [ 995.828865] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6432899c-b0aa-4285-971f-16ac27b1305b with Priority: HIGHEST for action security_group_members [ 995.829202] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20da233d-2947-43a6-88b1-229b364fbd48 with Priority: HIGHEST for action port [ 995.829667] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6432899c-b0aa-4285-971f-16ac27b1305b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.829972] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.831369] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.831369] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.831369] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6432899c-b0aa-4285-971f-16ac27b1305b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.831683] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-6432899c-b0aa-4285-971f-16ac27b1305b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.831919] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.832299] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-20da233d-2947-43a6-88b1-229b364fbd48 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.832556] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20da233d-2947-43a6-88b1-229b364fbd48" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.832710] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20da233d-2947-43a6-88b1-229b364fbd48" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.833066] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20da233d-2947-43a6-88b1-229b364fbd48" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.833257] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20da233d-2947-43a6-88b1-229b364fbd48',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.220035] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6: rpc.has_security_group_logging(os_id): False [ 996.220035] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.240817] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.240817] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.240817] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.240817] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.266745] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.266745] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.266745] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.266745] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.266745] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.266745] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.266745] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.266745] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.266745] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.266745] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.266745] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.266745] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.266745] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.266745] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.267597] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.267597] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.268328] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 is going to be updated. [ 996.280087] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.280087] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.280087] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.280087] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.280087] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.280304] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 is going to be updated. [ 996.334804] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-6432899c-b0aa-4285-971f-16ac27b1305b taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.335085] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.335151] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 20da233d-2947-43a6-88b1-229b364fbd48 with status ACTIVE [ 996.335351] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.335464] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.335538] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.335729] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.335817] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.336042] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.336169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.336242] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.336572] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.336572] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.336731] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.336731] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.336860] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.336906] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.336960] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.337033] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 20da233d-2947-43a6-88b1-229b364fbd48 is going to be updated. [ 996.341892] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.341892] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.342061] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.342154] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.342296] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.359970] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: IN_PROGRESS for 2s [ 996.365663] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.365940] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.365940] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.366164] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.366309] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.366481] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20da233d-2947-43a6-88b1-229b364fbd48" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.373521] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.373739] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.373782] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.374035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.374188] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.397356] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: IN_PROGRESS for 2s [ 996.723533] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.733022] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6432899c-b0aa-4285-971f-16ac27b1305b in Status: SUCCESS [ 996.733269] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6432899c-b0aa-4285-971f-16ac27b1305b deletion is rescheduled due to dependency. [ 996.733408] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.733615] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.733902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.734140] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.734281] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.734361] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.734567] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.734693] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.734828] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6432899c-b0aa-4285-971f-16ac27b1305b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.226344] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.226626] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.226626] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.226819] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.226909] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.227026] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 is going to be updated. [ 997.237173] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6432899c-b0aa-4285-971f-16ac27b1305b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.268642] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.268990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.268990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.269320] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.269946] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.281790] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: IN_PROGRESS for 2s [ 997.740880] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6432899c-b0aa-4285-971f-16ac27b1305b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.814395] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 in Status: SUCCESS [ 997.814395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.814395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.814395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.814395] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.814395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.814395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.814395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.814395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.814395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.815098] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c6dc57fb-f44d-4b26-87fe-bb8e4df202a8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.243562] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.243748] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.243820] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.244345] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.244428] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.244507] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6432899c-b0aa-4285-971f-16ac27b1305b is going to be updated. [ 998.287405] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.287765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.287765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.288378] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.288378] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.299693] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6432899c-b0aa-4285-971f-16ac27b1305b in Status: IN_PROGRESS for 2s [ 998.317619] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.317619] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.317619] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.317619] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.318073] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.318073] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.318073] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.318073] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.318306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.318306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.318504] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.319078] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.319078] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.319078] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.319078] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.319315] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.319315] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.319460] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.319532] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.319605] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.319707] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c6dc57fb-f44d-4b26-87fe-bb8e4df202a8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.379511] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: SUCCESS [ 998.379852] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.380111] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.380822] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.380822] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.380822] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.380822] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.381072] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.381193] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.382620] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.382620] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.382620] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.382620] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.382620] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.382620] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.382620] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.382620] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.383166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.383166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.383166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.383166] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.384350] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.384350] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.384467] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.384544] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.384626] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.384793] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.384873] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.385127] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.422310] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: SUCCESS [ 998.422574] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.422786] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.423148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.423265] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.822646] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c6dc57fb-f44d-4b26-87fe-bb8e4df202a8: rpc.has_security_group_logging(os_id): False [ 998.844687] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.844833] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.844904] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.845138] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.868817] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.868817] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.868817] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.869349] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.869349] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.869349] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.869349] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.869519] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.869519] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.869709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.869709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.870623] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.870623] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.870623] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.870623] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.870823] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.870823] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 is going to be updated. [ 998.887114] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bbf64d2-1030-46ae-99d0-42b29d7d0132: rpc.has_security_group_logging(os_id): False [ 998.889462] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.916741] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.916922] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.916970] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.918960] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.925592] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.925592] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.942723] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.943094] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.943281] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.943370] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.943611] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.943710] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.944018] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.944151] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.944218] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.944383] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.945425] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.945425] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.945425] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.945425] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.945425] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.945425] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.945425] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 is going to be updated. [ 998.950156] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.950156] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.950156] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.950321] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.950477] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.966440] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 in Status: IN_PROGRESS for 2s [ 999.033590] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.034591] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.034717] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.035056] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.035585] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.083059] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: IN_PROGRESS for 2s [ 999.305347] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: SUCCESS [ 999.305347] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.305347] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.305347] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.305347] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.305347] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.305347] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.305347] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.305347] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.305347] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.305347] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.394253] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.809933] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.809933] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.809933] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.810169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.810232] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.810392] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.810392] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.810530] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.810610] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.810752] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.810829] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.810945] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.811029] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.812108] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.812108] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.812108] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.812108] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.812108] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.812108] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.812108] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.812108] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.898922] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.899101] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.899101] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.899286] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.899380] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.899491] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 is going to be updated. [ 999.955626] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.955769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.955841] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.956570] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.956570] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.975994] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: IN_PROGRESS for 2s [ 1000.320809] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6: rpc.has_security_group_logging(os_id): False [ 1000.326872] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6432899c-b0aa-4285-971f-16ac27b1305b in Status: SUCCESS [ 1000.327136] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.327304] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.327917] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.327917] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.327917] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.328112] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.329544] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.329544] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.329544] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.329544] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6432899c-b0aa-4285-971f-16ac27b1305b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.352057] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.352290] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.352349] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.352586] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.352966] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.353269] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.353403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.353487] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.353695] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.353808] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.354045] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.354171] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.354248] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.354432] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.354524] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.354747] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.354875] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.354937] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.355093] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.355162] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.355251] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 is going to be updated. [ 1000.432828] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.432828] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.432828] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.432828] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.432828] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.462472] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: IN_PROGRESS for 2s [ 1000.829905] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1000.830024] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=6 [ 1000.831540] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-6432899c-b0aa-4285-971f-16ac27b1305b taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.831700] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.831766] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.831972] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.832152] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.832245] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.832310] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.832481] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.832559] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.832647] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.832795] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-6432899c-b0aa-4285-971f-16ac27b1305b taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.832909] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.833077] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.833169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.833313] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.833404] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.833463] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.833603] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.833679] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.833760] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.833855] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6432899c-b0aa-4285-971f-16ac27b1305b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.981498] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 in Status: SUCCESS [ 1000.981916] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.104351] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: SUCCESS [ 1001.104351] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.104952] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.105455] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.105811] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.336350] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6432899c-b0aa-4285-971f-16ac27b1305b: rpc.has_security_group_logging(os_id): False [ 1001.371765] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.371993] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.371993] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.372216] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.372303] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.372521] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.372615] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.372679] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.372851] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.372975] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.373204] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.373302] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.374548] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.374548] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.374548] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.374548] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.374548] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.374548] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.374548] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.374548] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.374548] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6432899c-b0aa-4285-971f-16ac27b1305b is going to be updated. [ 1001.466903] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.467054] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.469028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.469028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.469028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.492623] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6432899c-b0aa-4285-971f-16ac27b1305b in Status: IN_PROGRESS for 2s [ 1001.609612] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.609845] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.985013] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: SUCCESS [ 1001.985269] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.985446] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.985672] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.985864] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.985991] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.986125] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.986294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.986375] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.986456] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.986549] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.084842] env[65783]: INFO networking_nsxv3.common.synchronization [req-708b1c65-d78d-44fa-80bc-bb86c2e7cfed req-c536afb2-9e25-4e50-bbf8-ebf33705be4e tempest-ServerDiskConfigTestJSON-664757069 tempest-ServerDiskConfigTestJSON-664757069-project-member] Enqueued Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 1002.084905] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 1002.085756] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.085756] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.085756] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.085756] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.086085] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.086085] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.086085] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.086233] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.086271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.086666] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.481241] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: SUCCESS [ 1002.481241] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.492823] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.492823] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.492823] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.492823] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.492823] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.492823] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.492823] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.492823] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.492823] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.492823] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.492823] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.492823] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.492823] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.492823] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.492823] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.492823] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.493496] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.493496] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.493496] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.493496] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.493496] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.510408] env[65783]: INFO networking_nsxv3.common.synchronization [req-56f01d7b-9f3f-4b58-93fe-9bca4ca205a5 req-37a0a6c0-511c-4667-afbb-4fdc551e9e05 tempest-ServerActionsTestOtherA-298845163 tempest-ServerActionsTestOtherA-298845163-project-member] Enqueued Resource ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 with Priority: HIGHEST for action security_group_members [ 1002.510408] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 with Priority: HIGHEST for action security_group_members [ 1002.510408] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.513801] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.513801] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.513801] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.513801] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.513801] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.513801] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.513801] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.513801] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.513801] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6dc57fb-f44d-4b26-87fe-bb8e4df202a8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.573028] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-965 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.573325] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-965" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.573453] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-965" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.574460] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-965" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.576439] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.576439] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.576555] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.576849] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.576925] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.577177] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1002.577293] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1002.577400] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1002.577536] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1002.577614] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1002.577776] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1002.577921] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1002.581952] env[65783]: INFO networking_nsxv3.common.synchronization [req-56f01d7b-9f3f-4b58-93fe-9bca4ca205a5 req-37a0a6c0-511c-4667-afbb-4fdc551e9e05 tempest-ServerActionsTestOtherA-298845163 tempest-ServerActionsTestOtherA-298845163-project-member] Enqueued Resource ID: 9f372d9b-f11d-40fc-b795-bae66f4a1800 with Priority: HIGHEST for action port [ 1002.582858] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f372d9b-f11d-40fc-b795-bae66f4a1800 with Priority: HIGHEST for action port [ 1002.583660] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f372d9b-f11d-40fc-b795-bae66f4a1800 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.583834] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f372d9b-f11d-40fc-b795-bae66f4a1800" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.583946] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f372d9b-f11d-40fc-b795-bae66f4a1800" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.584217] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f372d9b-f11d-40fc-b795-bae66f4a1800" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.584321] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f372d9b-f11d-40fc-b795-bae66f4a1800',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.589431] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.589661] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.589661] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.589852] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.603420] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1002.603704] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1002.603932] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1002.604257] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-965" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.605044] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-79eedfab-2cdd-4443-821e-f2a69d774f98 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.605324] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-79eedfab-2cdd-4443-821e-f2a69d774f98" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.605509] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-79eedfab-2cdd-4443-821e-f2a69d774f98" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.606408] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-79eedfab-2cdd-4443-821e-f2a69d774f98" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.606620] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79eedfab-2cdd-4443-821e-f2a69d774f98',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.612760] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.613191] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.614780] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.614780] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.614780] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.614780] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.614780] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 is going to be updated. [ 1002.645077] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.645249] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.645298] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.645528] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.645670] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.656441] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: IN_PROGRESS for 2s [ 1002.998795] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bbf64d2-1030-46ae-99d0-42b29d7d0132: rpc.has_security_group_logging(os_id): False [ 1003.018745] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.018898] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.018972] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.019398] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.019490] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.019732] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.020059] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.020059] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.020192] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.020250] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.020356] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 is going to be updated. [ 1003.022132] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.022252] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.022323] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.022489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.022564] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.022739] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.022837] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.022891] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.023101] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.023177] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.023387] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.023482] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.023543] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.023685] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.023758] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.023941] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.024075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.024141] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.024286] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.024360] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.024444] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 is going to be updated. [ 1003.058827] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.059057] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.059057] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.059275] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.059418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.069229] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 in Status: IN_PROGRESS for 2s [ 1003.087712] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f372d9b-f11d-40fc-b795-bae66f4a1800 with status ACTIVE [ 1003.088381] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.088381] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.088381] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.088673] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.088742] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.088913] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.089067] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.089139] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.089345] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.089451] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.089708] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.089851] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.089984] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.090139] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.090280] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.090424] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f372d9b-f11d-40fc-b795-bae66f4a1800 is going to be updated. [ 1003.109885] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.110137] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.110137] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.110343] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.110495] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.112059] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.112237] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.112386] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.112653] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.112815] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.113025] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 79eedfab-2cdd-4443-821e-f2a69d774f98 not found, creating... [ 1003.113334] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.113501] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.113620] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.113895] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.114103] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.114417] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.114588] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.114712] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.114942] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.115101] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.115268] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 79eedfab-2cdd-4443-821e-f2a69d774f98 is going to be created. [ 1003.117996] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.118260] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.118260] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.118390] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.118453] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.118599] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f372d9b-f11d-40fc-b795-bae66f4a1800" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.136691] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: IN_PROGRESS for 2s [ 1003.140387] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.140597] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.140731] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.141136] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.141394] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.141608] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-79eedfab-2cdd-4443-821e-f2a69d774f98" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.515472] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6432899c-b0aa-4285-971f-16ac27b1305b in Status: SUCCESS [ 1003.516078] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.903875] env[65783]: INFO networking_nsxv3.common.synchronization [req-708b1c65-d78d-44fa-80bc-bb86c2e7cfed req-044b1db7-ad4d-4062-a7f7-a94d7ccc3f63 service nova] Enqueued Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_rules [ 1003.903875] env[65783]: INFO networking_nsxv3.common.synchronization [req-708b1c65-d78d-44fa-80bc-bb86c2e7cfed req-044b1db7-ad4d-4062-a7f7-a94d7ccc3f63 service nova] Enqueued Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 1003.903875] env[65783]: INFO networking_nsxv3.common.synchronization [req-708b1c65-d78d-44fa-80bc-bb86c2e7cfed req-044b1db7-ad4d-4062-a7f7-a94d7ccc3f63 service nova] Enqueued Resource ID: 79eedfab-2cdd-4443-821e-f2a69d774f98 with Priority: HIGHEST for action port [ 1003.904196] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_rules [ 1003.904414] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 1003.904530] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79eedfab-2cdd-4443-821e-f2a69d774f98 with Priority: HIGHEST for action port [ 1003.904814] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.905438] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.905438] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.905438] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.905438] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.906313] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.906436] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.906626] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-79eedfab-2cdd-4443-821e-f2a69d774f98 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.906722] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79eedfab-2cdd-4443-821e-f2a69d774f98" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.906858] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79eedfab-2cdd-4443-821e-f2a69d774f98" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.907431] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79eedfab-2cdd-4443-821e-f2a69d774f98" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.907431] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79eedfab-2cdd-4443-821e-f2a69d774f98',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.100086] env[65783]: INFO networking_nsxv3.common.synchronization [req-a28b262c-5618-403e-a756-0ddec8b433cb req-b549fbe7-da5d-4b08-ad38-c7bc6f23c3ce tempest-ImagesOneServerTestJSON-102617875 tempest-ImagesOneServerTestJSON-102617875-project-member] Enqueued Resource ID: 05d32358-32a3-497c-a1f6-14de2057f1b3 with Priority: HIGHEST for action security_group_members [ 1004.100617] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05d32358-32a3-497c-a1f6-14de2057f1b3 with Priority: HIGHEST for action security_group_members [ 1004.101722] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-05d32358-32a3-497c-a1f6-14de2057f1b3 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.101722] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.101838] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.102139] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.102206] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.102335] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.102452] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.102670] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.102787] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.102904] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05d32358-32a3-497c-a1f6-14de2057f1b3',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.105481] env[65783]: INFO networking_nsxv3.common.synchronization [None req-0bdb8375-f5c0-4fb2-ae67-2e4725834864 None None] Enqueued Resource ID: d138d38b-2094-49df-b8da-dec5d42d3f38 with Priority: HIGHEST for action port [ 1004.106289] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d138d38b-2094-49df-b8da-dec5d42d3f38 with Priority: HIGHEST for action port [ 1004.107538] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-d138d38b-2094-49df-b8da-dec5d42d3f38 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.107685] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d138d38b-2094-49df-b8da-dec5d42d3f38" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.107758] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d138d38b-2094-49df-b8da-dec5d42d3f38" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.107994] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d138d38b-2094-49df-b8da-dec5d42d3f38" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.108113] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d138d38b-2094-49df-b8da-dec5d42d3f38',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.381170] env[65783]: INFO networking_nsxv3.common.synchronization [req-2a40747f-5ba4-43db-bf7e-cd9629779c99 req-3f90e82a-98b5-40f8-ac84-2cdf4c4d1e5a tempest-ServerRescueNegativeTestJSON-1644419569 tempest-ServerRescueNegativeTestJSON-1644419569-project-member] Enqueued Resource ID: 0010338f-67e3-417c-be88-4e0a85ad75aa with Priority: HIGHEST for action security_group_members [ 1004.382051] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0010338f-67e3-417c-be88-4e0a85ad75aa with Priority: HIGHEST for action security_group_members [ 1004.382635] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-0010338f-67e3-417c-be88-4e0a85ad75aa taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.382936] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.383086] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.383456] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.383782] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.384021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.384204] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.384521] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.384729] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.384969] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0010338f-67e3-417c-be88-4e0a85ad75aa',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.409429] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.409682] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.410600] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 79eedfab-2cdd-4443-821e-f2a69d774f98 with status ACTIVE [ 1004.410600] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.410600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.410779] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.411022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.411212] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.411514] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.411686] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.411819] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.412257] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.412476] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.412847] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.413106] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.413291] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.413609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.413807] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.413986] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 79eedfab-2cdd-4443-821e-f2a69d774f98 is going to be updated. [ 1004.442936] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.443160] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.443234] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.443472] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.443637] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.443851] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79eedfab-2cdd-4443-821e-f2a69d774f98" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.611480] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d138d38b-2094-49df-b8da-dec5d42d3f38 [ 1004.611480] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.612376] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.612376] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.612376] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.612376] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.612376] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d138d38b-2094-49df-b8da-dec5d42d3f38 already deleted. [ 1004.612376] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d138d38b-2094-49df-b8da-dec5d42d3f38" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.612801] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.612854] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.614398] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.614398] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.638519] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.638883] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.639236] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.639343] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.639584] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.639970] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.639970] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05d32358-32a3-497c-a1f6-14de2057f1b3 is going to be updated. [ 1004.671299] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: SUCCESS [ 1004.671526] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 deletion is rescheduled due to dependency. [ 1004.671690] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.671761] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.672088] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.672171] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.672288] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.672343] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.672492] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.673220] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.673220] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.674423] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.674531] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.674662] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.674825] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.674954] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.683742] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05d32358-32a3-497c-a1f6-14de2057f1b3 in Status: IN_PROGRESS for 2s [ 1004.889167] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0010338f-67e3-417c-be88-4e0a85ad75aa',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.080944] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 in Status: SUCCESS [ 1005.080944] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 deletion is rescheduled due to dependency. [ 1005.080944] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.154416] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: SUCCESS [ 1005.154719] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.177937] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.391383] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0010338f-67e3-417c-be88-4e0a85ad75aa',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.469386] env[65783]: INFO networking_nsxv3.common.synchronization [None req-60124f30-85ef-4bd9-84ed-2c215a37d2aa tempest-ServersTestFqdnHostnames-296510809 tempest-ServersTestFqdnHostnames-296510809-project-member] Enqueued Resource ID: af1375c2-7b1e-420c-a8d1-1ccf5e01438b with Priority: HIGHEST for action security_group_rules [ 1005.469808] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1375c2-7b1e-420c-a8d1-1ccf5e01438b with Priority: HIGHEST for action security_group_rules [ 1005.470150] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af1375c2-7b1e-420c-a8d1-1ccf5e01438b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.470514] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.470514] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.470659] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.470724] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af1375c2-7b1e-420c-a8d1-1ccf5e01438b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.576438] env[65783]: INFO networking_nsxv3.common.synchronization [None req-16677607-f32c-4e6a-aac9-410a131d12a4 tempest-ServersTestFqdnHostnames-296510809 tempest-ServersTestFqdnHostnames-296510809-project-member] Enqueued Resource ID: af1375c2-7b1e-420c-a8d1-1ccf5e01438b with Priority: HIGHEST for action security_group_rules [ 1005.576952] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1375c2-7b1e-420c-a8d1-1ccf5e01438b with Priority: HIGHEST for action security_group_rules [ 1005.577291] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af1375c2-7b1e-420c-a8d1-1ccf5e01438b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.577396] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.680621] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.897314] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.897314] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.897314] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.897521] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.897559] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.897668] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0010338f-67e3-417c-be88-4e0a85ad75aa is going to be updated. [ 1005.933913] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.933913] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.933913] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.934152] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.934195] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.946602] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0010338f-67e3-417c-be88-4e0a85ad75aa in Status: IN_PROGRESS for 2s [ 1005.992559] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.992720] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.992779] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.992980] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.993099] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.993200] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af1375c2-7b1e-420c-a8d1-1ccf5e01438b already deleted. [ 1005.993291] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.993551] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.993733] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.993814] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af1375c2-7b1e-420c-a8d1-1ccf5e01438b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.181478] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.181662] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.181711] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.181926] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.182037] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.182146] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 is going to be updated. [ 1006.226019] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.226219] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.226313] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.226520] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.226789] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.240085] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: IN_PROGRESS for 2s [ 1006.522598] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.522598] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.522598] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.522598] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.522598] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.523134] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af1375c2-7b1e-420c-a8d1-1ccf5e01438b already deleted. [ 1006.523134] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.695199] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05d32358-32a3-497c-a1f6-14de2057f1b3 in Status: SUCCESS [ 1006.695530] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05d32358-32a3-497c-a1f6-14de2057f1b3 deletion is rescheduled due to dependency. [ 1006.695530] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.167992] env[65783]: INFO networking_nsxv3.common.synchronization [None req-f3f907b4-7262-43d1-895f-558715790f18 None None] Enqueued Resource ID: d2ea523f-d6a6-4649-8f6b-cdd3db719d69 with Priority: HIGHEST for action port [ 1007.168586] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2ea523f-d6a6-4649-8f6b-cdd3db719d69 with Priority: HIGHEST for action port [ 1007.168942] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2ea523f-d6a6-4649-8f6b-cdd3db719d69 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.169094] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2ea523f-d6a6-4649-8f6b-cdd3db719d69" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.169164] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2ea523f-d6a6-4649-8f6b-cdd3db719d69" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.169913] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2ea523f-d6a6-4649-8f6b-cdd3db719d69" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.169913] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2ea523f-d6a6-4649-8f6b-cdd3db719d69',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.673810] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d2ea523f-d6a6-4649-8f6b-cdd3db719d69 [ 1007.673810] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.673810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.673810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.673810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.673810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.673810] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d2ea523f-d6a6-4649-8f6b-cdd3db719d69 already deleted. [ 1007.673810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2ea523f-d6a6-4649-8f6b-cdd3db719d69" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.935945] env[65783]: INFO networking_nsxv3.common.synchronization [req-12e83864-8f50-4ef5-97dd-51601eaf6d3e req-f22b6470-8592-46ba-a24c-1bd32a58c32e tempest-ServersTestMultiNic-291669374 tempest-ServersTestMultiNic-291669374-project-member] Enqueued Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 1007.936928] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 1007.937389] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.937641] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.937799] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.938091] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.938343] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.938553] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.938700] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.938943] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.939148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.939348] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.958102] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0010338f-67e3-417c-be88-4e0a85ad75aa in Status: SUCCESS [ 1007.958102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.219277] env[65783]: INFO networking_nsxv3.common.synchronization [req-12e83864-8f50-4ef5-97dd-51601eaf6d3e req-1a8b3eb0-0c75-4bef-8037-a54152678b6c tempest-ServersTestMultiNic-291669374 tempest-ServersTestMultiNic-291669374-project-member] Enqueued Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 1008.220311] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGHEST for action security_group_members [ 1008.221791] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.221791] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.257945] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: SUCCESS [ 1008.259866] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.259866] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.259866] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.259866] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.259866] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.259866] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.259866] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.259866] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.259866] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.259866] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.331494] env[65783]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1008.332631] env[65783]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1008.442702] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.686338] env[65783]: INFO networking_nsxv3.common.synchronization [req-048c6c4a-ba41-46fb-8c1e-15a2780dec26 req-a6c42e61-58c4-4856-bdbc-417ac57fa320 tempest-ImagesOneServerNegativeTestJSON-1524253690 tempest-ImagesOneServerNegativeTestJSON-1524253690-project-member] Enqueued Resource ID: 6432899c-b0aa-4285-971f-16ac27b1305b with Priority: HIGHEST for action security_group_members [ 1008.686964] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6432899c-b0aa-4285-971f-16ac27b1305b with Priority: HIGHEST for action security_group_members [ 1008.687331] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-6432899c-b0aa-4285-971f-16ac27b1305b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.687450] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.687516] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.687755] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.687929] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.691113] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.691265] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.691470] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.691580] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.691685] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6432899c-b0aa-4285-971f-16ac27b1305b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.762807] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.762997] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.763067] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.763361] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.763544] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.763631] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.763862] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.763862] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.763939] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.763989] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.766044] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.766044] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.766044] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.766044] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.766044] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.766044] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.766044] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.766044] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.766044] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.766044] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.767079] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.946207] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.040540] env[65783]: INFO networking_nsxv3.common.synchronization [req-00548f4f-fc27-4cc1-917c-e36ac2ae577f req-2e08d54a-5dbd-455f-ad73-7cf07d463c27 tempest-MultipleCreateTestJSON-1108671505 tempest-MultipleCreateTestJSON-1108671505-project-member] Enqueued Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_members [ 1009.044883] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_members [ 1009.045383] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.045626] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.046032] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.046159] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.046866] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.046866] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.046866] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.047684] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.047876] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.048238] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.194759] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.196796] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.196796] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.196796] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.196796] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.196796] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.196796] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.196796] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.196796] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.196796] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.196796] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6432899c-b0aa-4285-971f-16ac27b1305b is going to be updated. [ 1009.228438] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.228566] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.228707] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.228838] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.228972] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.240467] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6432899c-b0aa-4285-971f-16ac27b1305b in Status: IN_PROGRESS for 2s [ 1009.268170] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9943d881-28bf-4885-906c-d360f9c2c3e7: rpc.has_security_group_logging(os_id): False [ 1009.292089] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.292342] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.292415] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.292633] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.292718] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.292931] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.293113] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.293178] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.293341] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.293419] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.293633] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.293725] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.293784] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.293924] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.294014] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.294429] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.294528] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.294587] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.294735] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.294807] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.294890] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 is going to be updated. [ 1009.381102] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.381258] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.381406] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.381695] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.381846] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.400023] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: IN_PROGRESS for 2s [ 1009.452636] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.452636] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.452636] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.452636] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.452636] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.452636] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 is going to be updated. [ 1009.513900] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.513900] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.513900] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.513900] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.514303] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.524709] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: IN_PROGRESS for 2s [ 1009.539370] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-73 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.540160] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-73" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.540160] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-73" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.541023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-73" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.541023] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.541023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.541023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.541293] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.541333] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.542026] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1009.542026] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1009.542026] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1009.542201] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1009.542201] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1009.542286] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1009.542401] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1009.553199] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.553377] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.553449] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.553676] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.553766] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.554029] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.554225] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.554318] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.554508] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.554593] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.554690] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 already deleted. [ 1009.554775] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.578457] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1009.578649] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1009.578845] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1009.578987] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-73" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.579450] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-bceffc39-3195-4064-9ae1-646b7a191ae7 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.579725] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-bceffc39-3195-4064-9ae1-646b7a191ae7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.579885] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-bceffc39-3195-4064-9ae1-646b7a191ae7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.580274] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-bceffc39-3195-4064-9ae1-646b7a191ae7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.580447] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bceffc39-3195-4064-9ae1-646b7a191ae7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.083309] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.083760] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.084067] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.084393] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.085350] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.085350] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port bceffc39-3195-4064-9ae1-646b7a191ae7 not found, creating... [ 1010.085350] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.085528] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.086382] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.086755] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.086952] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.087365] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.087596] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.087722] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.088043] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.088275] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.088517] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: bceffc39-3195-4064-9ae1-646b7a191ae7 is going to be created. [ 1010.110588] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.110827] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.111047] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.111323] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.111609] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.112065] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-bceffc39-3195-4064-9ae1-646b7a191ae7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.861831] env[65783]: INFO networking_nsxv3.common.synchronization [req-00548f4f-fc27-4cc1-917c-e36ac2ae577f req-f8328447-81cd-45ce-a128-8d1cd8d5d5ef service nova] Enqueued Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_rules [ 1010.861831] env[65783]: INFO networking_nsxv3.common.synchronization [req-00548f4f-fc27-4cc1-917c-e36ac2ae577f req-f8328447-81cd-45ce-a128-8d1cd8d5d5ef service nova] Enqueued Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_members [ 1010.861831] env[65783]: INFO networking_nsxv3.common.synchronization [req-00548f4f-fc27-4cc1-917c-e36ac2ae577f req-f8328447-81cd-45ce-a128-8d1cd8d5d5ef service nova] Enqueued Resource ID: bceffc39-3195-4064-9ae1-646b7a191ae7 with Priority: HIGHEST for action port [ 1010.861831] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_rules [ 1010.861831] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_members [ 1010.861831] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bceffc39-3195-4064-9ae1-646b7a191ae7 with Priority: HIGHEST for action port [ 1010.861831] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.861831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.861831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.862372] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.862372] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.863425] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.863425] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.863605] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.864432] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.864432] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.864432] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.864432] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.864432] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.864432] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.864861] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.866071] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-bceffc39-3195-4064-9ae1-646b7a191ae7 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.866484] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bceffc39-3195-4064-9ae1-646b7a191ae7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.866484] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bceffc39-3195-4064-9ae1-646b7a191ae7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.867291] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bceffc39-3195-4064-9ae1-646b7a191ae7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.867291] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bceffc39-3195-4064-9ae1-646b7a191ae7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.251445] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6432899c-b0aa-4285-971f-16ac27b1305b in Status: SUCCESS [ 1011.251445] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6432899c-b0aa-4285-971f-16ac27b1305b deletion is rescheduled due to dependency. [ 1011.251832] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.366791] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.368953] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.369396] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.369721] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bceffc39-3195-4064-9ae1-646b7a191ae7 with status ACTIVE [ 1011.369964] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.370091] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.370091] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.370457] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.370556] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.371028] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.371028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.371028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.371216] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.371259] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.371441] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.371536] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.371589] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.371740] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.372601] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.372712] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bceffc39-3195-4064-9ae1-646b7a191ae7 is going to be updated. [ 1011.401028] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.401028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.401028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.401276] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.401419] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.401604] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bceffc39-3195-4064-9ae1-646b7a191ae7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.417276] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: SUCCESS [ 1011.417572] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.468137] env[65783]: INFO networking_nsxv3.common.synchronization [req-d3209e8e-932d-4370-92ad-01d9f606736a req-a6a9df51-16ac-4f41-aa22-d2fa22448263 tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 with Priority: HIGHEST for action security_group_members [ 1011.468318] env[65783]: INFO networking_nsxv3.common.synchronization [req-d3209e8e-932d-4370-92ad-01d9f606736a req-a6a9df51-16ac-4f41-aa22-d2fa22448263 tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: 9b8bb0e6-1d22-4e95-a649-fc4d3180195b with Priority: HIGHEST for action security_group_members [ 1011.469037] env[65783]: INFO networking_nsxv3.common.synchronization [req-d3209e8e-932d-4370-92ad-01d9f606736a req-a6a9df51-16ac-4f41-aa22-d2fa22448263 tempest-SecurityGroupsTestJSON-451462583 tempest-SecurityGroupsTestJSON-451462583-project-member] Enqueued Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_members [ 1011.470213] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 with Priority: HIGHEST for action security_group_members [ 1011.471041] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b8bb0e6-1d22-4e95-a649-fc4d3180195b with Priority: HIGHEST for action security_group_members [ 1011.471041] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGHEST for action security_group_members [ 1011.471041] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.471350] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.471350] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.471473] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.471704] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.471819] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.471881] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.472136] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.472229] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.472322] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dccc2c0a-475d-4f38-ad2a-2e54cdca65b1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.473454] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b8bb0e6-1d22-4e95-a649-fc4d3180195b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.473642] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b8bb0e6-1d22-4e95-a649-fc4d3180195b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.473642] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b8bb0e6-1d22-4e95-a649-fc4d3180195b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.473802] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b8bb0e6-1d22-4e95-a649-fc4d3180195b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.473927] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.475467] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.475467] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.475467] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.475467] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.475467] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b8bb0e6-1d22-4e95-a649-fc4d3180195b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.475788] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.475841] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.475933] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.477051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.477051] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.477051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.477051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.477051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.477051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.477051] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.546829] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: SUCCESS [ 1011.547073] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.547073] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.547317] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.547583] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.547736] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.547808] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.547969] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.548071] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.548211] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.680578] env[65783]: INFO networking_nsxv3.common.synchronization [req-00548f4f-fc27-4cc1-917c-e36ac2ae577f req-0b6bfdda-06e0-4d1a-a5b3-daa61150e058 tempest-MultipleCreateTestJSON-1108671505 tempest-MultipleCreateTestJSON-1108671505-project-member] Enqueued Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_members [ 1011.681458] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_members [ 1011.681901] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.685215] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.869051] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.979865] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.980068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.980068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.980207] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.981495] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.981597] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.981823] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.981903] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.983839] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-73 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.984049] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-73" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.984244] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-73" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.984473] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-73" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.984725] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.984882] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.984999] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.985225] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.985374] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.985577] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1011.985692] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1011.985802] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1011.985911] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1011.986032] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1011.986147] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1011.986272] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1012.008028] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1012.008028] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1012.008028] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1012.008028] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-73" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.008028] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-81a17df2-1bdf-4672-a9d0-4fcd91b8edf6 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.008028] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-81a17df2-1bdf-4672-a9d0-4fcd91b8edf6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.008028] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-81a17df2-1bdf-4672-a9d0-4fcd91b8edf6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.008028] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-81a17df2-1bdf-4672-a9d0-4fcd91b8edf6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.008028] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81a17df2-1bdf-4672-a9d0-4fcd91b8edf6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.009394] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.010213] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.010513] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.011794] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.011794] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.011794] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.011794] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 is going to be updated. [ 1012.013110] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.015373] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.031530] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.034169] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.034169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.034169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.034169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.034169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.034169] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b8bb0e6-1d22-4e95-a649-fc4d3180195b is going to be updated. [ 1012.034169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.034936] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.035197] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.035722] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.035999] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.036208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.037055] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.037055] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.037055] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 is going to be updated. [ 1012.040542] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.040542] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.040542] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.040733] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.040935] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.051063] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 in Status: IN_PROGRESS for 2s [ 1012.051453] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.051544] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.051814] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.051814] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.052435] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.052435] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.052435] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.052435] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.052435] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.052435] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.052803] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 is going to be updated. [ 1012.072177] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.072446] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.072531] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.073075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.073234] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.075291] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.075408] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.075575] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.075814] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.075978] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.086313] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.086581] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.086581] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.086794] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.086912] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.088625] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: IN_PROGRESS for 2s [ 1012.089256] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b8bb0e6-1d22-4e95-a649-fc4d3180195b in Status: IN_PROGRESS for 2s [ 1012.099785] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: IN_PROGRESS for 2s [ 1012.371823] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.372088] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.372141] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.372388] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.372508] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.372637] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 is going to be created. [ 1012.401315] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.401475] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.401556] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.401765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.401931] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.414300] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 in Status: UNINITIALIZED for 2s [ 1012.515730] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.516069] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.516154] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.516417] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.516573] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.516728] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 81a17df2-1bdf-4672-a9d0-4fcd91b8edf6 not found, creating... [ 1012.516990] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.517164] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.517266] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.517485] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.517619] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.517926] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.518086] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.518244] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.518467] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.518602] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.518950] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 81a17df2-1bdf-4672-a9d0-4fcd91b8edf6 is going to be created. [ 1012.540067] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.540356] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.540574] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.541076] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.541380] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.541768] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-81a17df2-1bdf-4672-a9d0-4fcd91b8edf6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.278985] env[65783]: INFO networking_nsxv3.common.synchronization [req-00548f4f-fc27-4cc1-917c-e36ac2ae577f req-37cb59b0-5d25-47b6-8ee2-bc4f81e4387a service nova] Enqueued Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_rules [ 1013.279140] env[65783]: INFO networking_nsxv3.common.synchronization [req-00548f4f-fc27-4cc1-917c-e36ac2ae577f req-37cb59b0-5d25-47b6-8ee2-bc4f81e4387a service nova] Enqueued Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_members [ 1013.279340] env[65783]: INFO networking_nsxv3.common.synchronization [req-00548f4f-fc27-4cc1-917c-e36ac2ae577f req-37cb59b0-5d25-47b6-8ee2-bc4f81e4387a service nova] Enqueued Resource ID: 81a17df2-1bdf-4672-a9d0-4fcd91b8edf6 with Priority: HIGHEST for action port [ 1013.279876] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_rules [ 1013.280057] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_members [ 1013.280194] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81a17df2-1bdf-4672-a9d0-4fcd91b8edf6 with Priority: HIGHEST for action port [ 1013.280514] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.280639] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.280880] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.281026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.281265] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-81a17df2-1bdf-4672-a9d0-4fcd91b8edf6 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.281386] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81a17df2-1bdf-4672-a9d0-4fcd91b8edf6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.281473] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81a17df2-1bdf-4672-a9d0-4fcd91b8edf6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.281695] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81a17df2-1bdf-4672-a9d0-4fcd91b8edf6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.281797] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81a17df2-1bdf-4672-a9d0-4fcd91b8edf6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.785555] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 81a17df2-1bdf-4672-a9d0-4fcd91b8edf6 with status ACTIVE [ 1013.785966] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.785966] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.786125] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.786834] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.786834] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.786834] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.786834] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.786834] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.786834] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.787243] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.787243] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.787243] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.787369] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.787446] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.787536] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.787602] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 81a17df2-1bdf-4672-a9d0-4fcd91b8edf6 is going to be updated. [ 1013.809420] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.809580] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.809650] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.809871] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.810013] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.810174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81a17df2-1bdf-4672-a9d0-4fcd91b8edf6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.061019] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 in Status: SUCCESS [ 1014.061245] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 deletion is rescheduled due to dependency. [ 1014.061361] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.101265] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b8bb0e6-1d22-4e95-a649-fc4d3180195b in Status: SUCCESS [ 1014.101419] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b8bb0e6-1d22-4e95-a649-fc4d3180195b deletion is rescheduled due to dependency. [ 1014.101495] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b8bb0e6-1d22-4e95-a649-fc4d3180195b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.103351] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 in Status: SUCCESS [ 1014.103537] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 deletion is rescheduled due to dependency. [ 1014.103630] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.111799] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 in Status: SUCCESS [ 1014.112016] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 deletion is rescheduled due to dependency. [ 1014.112284] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.423890] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 in Status: SUCCESS [ 1014.424172] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.424284] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.424518] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.424706] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.424812] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.424877] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.425049] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.425122] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.425208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.425299] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.426215] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.426404] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.426564] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.426742] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.426810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.426958] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.427054] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.427140] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.722506] env[65783]: INFO networking_nsxv3.common.synchronization [req-cd945682-4dc3-4373-a366-5528d6086f5f req-b6735a5c-2c7a-4697-9389-e15ec427384e tempest-DeleteServersTestJSON-1456685968 tempest-DeleteServersTestJSON-1456685968-project-member] Enqueued Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 1014.723966] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 1014.723966] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.723966] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.723966] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.723966] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.724273] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.724273] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.724273] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.724396] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.724452] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.724546] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.928664] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.929058] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.930280] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.227414] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.227414] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.227644] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.227794] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.253568] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.253908] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.254092] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.254266] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.254468] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.254651] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.254796] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 is going to be updated. [ 1015.288188] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.288410] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.288463] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.289026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.289026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.307091] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: IN_PROGRESS for 2s [ 1015.432994] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.935989] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.936454] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.936454] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.936742] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.936877] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.937020] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 is going to be updated. [ 1015.982409] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.982409] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.982409] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.982702] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.982864] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.993386] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 in Status: IN_PROGRESS for 2s [ 1016.843892] env[65783]: INFO networking_nsxv3.common.synchronization [req-b68f5835-1cc8-48b7-ac56-32f7652182ec req-54e30df4-48af-4c16-bd16-12e782670418 tempest-ServersTestManualDisk-213355435 tempest-ServersTestManualDisk-213355435-project-member] Enqueued Resource ID: 72614839-90ad-4218-8056-d4c6f35d8448 with Priority: HIGHEST for action security_group_members [ 1016.844531] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72614839-90ad-4218-8056-d4c6f35d8448 with Priority: HIGHEST for action security_group_members [ 1016.844848] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-72614839-90ad-4218-8056-d4c6f35d8448 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.845029] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.845128] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.845359] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.845555] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.845687] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.845788] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.845965] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.846100] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.846223] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72614839-90ad-4218-8056-d4c6f35d8448',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.211443] env[65783]: INFO networking_nsxv3.common.synchronization [req-dc8255cb-ed0b-44be-85e3-15084a9e8fc7 req-00d8d8b9-e736-40c3-9197-4d306fd16b66 tempest-ServerDiskConfigTestJSON-664757069 tempest-ServerDiskConfigTestJSON-664757069-project-member] Enqueued Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 1017.212163] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGHEST for action security_group_members [ 1017.212694] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.212855] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.213023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.213483] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.213555] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.213638] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.213826] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.214606] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.214606] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.214606] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.319079] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: SUCCESS [ 1017.319079] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 deletion is rescheduled due to dependency. [ 1017.319079] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.350790] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.350790] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.350790] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.350790] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.372811] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.373280] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.373403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.373532] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.373871] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.373871] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.374071] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72614839-90ad-4218-8056-d4c6f35d8448 is going to be updated. [ 1017.405483] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.405483] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.405483] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.405732] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.405780] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.409663] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-403 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.409887] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-403" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.410020] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-403" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.410318] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-403" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.410603] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.410771] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.410900] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.411172] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.411328] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.411545] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1017.411658] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1017.411765] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1017.411870] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1017.411979] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1017.412093] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1017.412227] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1017.416874] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72614839-90ad-4218-8056-d4c6f35d8448 in Status: IN_PROGRESS for 2s [ 1017.433714] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1017.434841] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1017.434841] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1017.434841] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-403" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.434841] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-2cd6eb89-f768-4ee6-93a2-386b83c42638 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.434841] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-2cd6eb89-f768-4ee6-93a2-386b83c42638" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.434841] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-2cd6eb89-f768-4ee6-93a2-386b83c42638" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.435331] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-2cd6eb89-f768-4ee6-93a2-386b83c42638" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.435474] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cd6eb89-f768-4ee6-93a2-386b83c42638',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.716749] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.716911] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.716966] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.717214] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.717300] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.717505] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.717605] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.717679] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.717812] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.717889] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.717973] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 is going to be updated. [ 1017.750148] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.750292] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.750369] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.750567] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.750702] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.769398] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: IN_PROGRESS for 2s [ 1017.938282] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.938504] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.938629] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.938905] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.939065] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.939354] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.939506] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.940103] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.940103] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.940103] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.940251] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.940376] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.940480] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.940686] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.940818] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.940948] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 2cd6eb89-f768-4ee6-93a2-386b83c42638 is going to be updated. [ 1017.964074] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.964074] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.964074] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.964364] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.964364] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.964577] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-2cd6eb89-f768-4ee6-93a2-386b83c42638" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.004808] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 in Status: SUCCESS [ 1018.005043] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.005232] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.005490] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.005737] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.005807] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.005847] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.006773] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.006773] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.006773] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.508569] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.714204] env[65783]: INFO networking_nsxv3.common.synchronization [req-c579bf94-4284-4fa8-bd0f-0ff62534fa79 req-2cedd10d-014a-484f-b667-1eaceb2720d3 service nova] Enqueued Resource ID: a938b55d-b711-4079-9f7b-f27235895480 with Priority: HIGHEST for action security_group_rules [ 1018.714396] env[65783]: INFO networking_nsxv3.common.synchronization [req-c579bf94-4284-4fa8-bd0f-0ff62534fa79 req-2cedd10d-014a-484f-b667-1eaceb2720d3 service nova] Enqueued Resource ID: a938b55d-b711-4079-9f7b-f27235895480 with Priority: HIGHEST for action security_group_members [ 1018.714432] env[65783]: INFO networking_nsxv3.common.synchronization [req-c579bf94-4284-4fa8-bd0f-0ff62534fa79 req-2cedd10d-014a-484f-b667-1eaceb2720d3 service nova] Enqueued Resource ID: 2cd6eb89-f768-4ee6-93a2-386b83c42638 with Priority: HIGHEST for action port [ 1018.715438] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a938b55d-b711-4079-9f7b-f27235895480 with Priority: HIGHEST for action security_group_rules [ 1018.715438] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a938b55d-b711-4079-9f7b-f27235895480 with Priority: HIGHEST for action security_group_members [ 1018.715631] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cd6eb89-f768-4ee6-93a2-386b83c42638 with Priority: HIGHEST for action port [ 1018.715820] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a938b55d-b711-4079-9f7b-f27235895480 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.715926] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.716034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.716254] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.716335] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.717293] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a938b55d-b711-4079-9f7b-f27235895480 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.717401] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.717467] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.717634] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.717777] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.717869] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.717933] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.718114] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.718207] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.718296] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.719520] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cd6eb89-f768-4ee6-93a2-386b83c42638 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.719520] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cd6eb89-f768-4ee6-93a2-386b83c42638" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.719520] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cd6eb89-f768-4ee6-93a2-386b83c42638" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.719520] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cd6eb89-f768-4ee6-93a2-386b83c42638" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.719520] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cd6eb89-f768-4ee6-93a2-386b83c42638',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.011417] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.220990] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a938b55d-b711-4079-9f7b-f27235895480 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.221236] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.221492] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.222597] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2cd6eb89-f768-4ee6-93a2-386b83c42638 with status ACTIVE [ 1019.222969] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.223083] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.223231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.223475] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.223618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.223863] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.223993] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.228019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.228019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.228019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.228019] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.228019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.228019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.228019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.228019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.228019] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2cd6eb89-f768-4ee6-93a2-386b83c42638 is going to be updated. [ 1019.259518] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.259833] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.259930] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.260310] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.260529] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.260782] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cd6eb89-f768-4ee6-93a2-386b83c42638" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.428915] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72614839-90ad-4218-8056-d4c6f35d8448 in Status: SUCCESS [ 1019.428915] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72614839-90ad-4218-8056-d4c6f35d8448 deletion is rescheduled due to dependency. [ 1019.429064] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.513697] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.514058] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.514058] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.514444] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.514444] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.514551] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 is going to be updated. [ 1019.547803] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.547995] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.548931] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.548931] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.548931] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.571295] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 in Status: IN_PROGRESS for 2s [ 1019.732819] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.780195] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 in Status: SUCCESS [ 1019.780386] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 deletion is rescheduled due to dependency. [ 1019.780526] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.235931] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.236111] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.236111] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.236281] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.236366] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.236463] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a938b55d-b711-4079-9f7b-f27235895480 is going to be updated. [ 1020.282562] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.282822] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.282822] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.282967] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.283204] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.294591] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a938b55d-b711-4079-9f7b-f27235895480 in Status: IN_PROGRESS for 2s [ 1021.582912] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 in Status: SUCCESS [ 1021.583287] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.583433] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.583649] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.583839] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.583954] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.584041] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.584200] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.584308] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.584388] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.584513] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.584600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.584665] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.584797] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.584935] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.585071] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.585279] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.585279] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.585428] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.585824] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.585824] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.089602] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76: rpc.has_security_group_logging(os_id): False [ 1022.114044] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.114331] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.114331] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.115117] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.115117] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.115117] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.115117] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.115117] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.115462] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.115462] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.115569] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.115718] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.115718] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.115864] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.115935] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.116312] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.116425] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.116425] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.116603] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.116657] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.116737] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 is going to be created. [ 1022.200376] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.200376] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.200376] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.200376] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.200376] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.213929] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 in Status: IN_PROGRESS for 2s [ 1022.307682] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a938b55d-b711-4079-9f7b-f27235895480 in Status: SUCCESS [ 1022.307913] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.308204] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.308433] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.308631] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.308745] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.308810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.308945] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.309030] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.309177] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.309282] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.816481] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a938b55d-b711-4079-9f7b-f27235895480 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.816764] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.816764] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.816897] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.817042] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.817137] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.817197] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.817318] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.817416] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.817481] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.817632] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a938b55d-b711-4079-9f7b-f27235895480 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.817756] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.817844] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.818031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.818558] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.818558] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.818558] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.818558] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.818558] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.818782] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.818782] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.321363] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a938b55d-b711-4079-9f7b-f27235895480: rpc.has_security_group_logging(os_id): False [ 1023.347715] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.347905] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.348437] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.348437] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.372720] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.373009] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.373386] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.373475] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.373692] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.373775] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.374026] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.374209] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.374274] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.374426] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.374502] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.374691] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.374786] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.374847] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.374985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.375072] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.375166] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a938b55d-b711-4079-9f7b-f27235895480 is going to be updated. [ 1023.459134] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.459134] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.459134] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.459465] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.459465] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.476795] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a938b55d-b711-4079-9f7b-f27235895480 in Status: IN_PROGRESS for 2s [ 1023.716978] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1023.717250] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1024.229817] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 in Status: SUCCESS [ 1024.230235] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.230387] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.230615] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.230701] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.733593] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.733821] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.733821] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.734029] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.734237] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.734404] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.734404] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.734523] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.734613] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.734698] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.734784] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.839903] env[65783]: INFO networking_nsxv3.common.synchronization [None req-01218cc2-128e-4d08-9435-1048fa40f006 None None] Enqueued Resource ID: 7c8bcb51-47dd-4d94-9950-d2df6a52757b with Priority: HIGHEST for action port [ 1024.839903] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c8bcb51-47dd-4d94-9950-d2df6a52757b with Priority: HIGHEST for action port [ 1024.839903] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c8bcb51-47dd-4d94-9950-d2df6a52757b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.839903] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c8bcb51-47dd-4d94-9950-d2df6a52757b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.839903] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c8bcb51-47dd-4d94-9950-d2df6a52757b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.839903] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c8bcb51-47dd-4d94-9950-d2df6a52757b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.840554] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c8bcb51-47dd-4d94-9950-d2df6a52757b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.850058] env[65783]: INFO networking_nsxv3.common.synchronization [req-7fd01214-5567-48c5-bd50-8b0a01e0db50 req-36a51ed4-1da2-4cd1-8391-a99a49cc5f55 tempest-ServerRescueNegativeTestJSON-1644419569 tempest-ServerRescueNegativeTestJSON-1644419569-project-member] Enqueued Resource ID: 0010338f-67e3-417c-be88-4e0a85ad75aa with Priority: HIGHEST for action security_group_members [ 1024.851282] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0010338f-67e3-417c-be88-4e0a85ad75aa with Priority: HIGHEST for action security_group_members [ 1024.851282] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-0010338f-67e3-417c-be88-4e0a85ad75aa taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.851282] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.851282] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.851282] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.851569] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.851569] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.851569] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.851844] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.851844] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.851963] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0010338f-67e3-417c-be88-4e0a85ad75aa',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.236863] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.237310] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.237310] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.237481] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.237666] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.238321] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.238321] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.238321] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.238321] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.238321] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.238551] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.238551] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.238551] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.238863] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.239093] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.239185] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.239270] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.239454] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.240142] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.240142] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.240142] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.336387] env[65783]: INFO networking_nsxv3.common.synchronization [req-48690ab9-1989-48a3-a76a-7e97931fe0f5 req-d3daffd6-3a3d-40a3-b766-c0c21f19b2eb tempest-ServersTestFqdnHostnames-296510809 tempest-ServersTestFqdnHostnames-296510809-project-member] Enqueued Resource ID: af1375c2-7b1e-420c-a8d1-1ccf5e01438b with Priority: HIGHEST for action security_group_members [ 1025.336678] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1375c2-7b1e-420c-a8d1-1ccf5e01438b with Priority: HIGHEST for action security_group_members [ 1025.336976] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1375c2-7b1e-420c-a8d1-1ccf5e01438b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.338946] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.338946] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.338946] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.338946] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.338946] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.338946] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.338946] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.338946] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.338946] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1375c2-7b1e-420c-a8d1-1ccf5e01438b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.343615] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c8bcb51-47dd-4d94-9950-d2df6a52757b [ 1025.343615] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.343615] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.343615] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.343615] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.343615] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.343615] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c8bcb51-47dd-4d94-9950-d2df6a52757b already deleted. [ 1025.343615] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c8bcb51-47dd-4d94-9950-d2df6a52757b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.355324] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.355324] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.355324] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.355550] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.381188] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.381543] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.381681] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.381727] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.381930] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.382793] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.382934] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0010338f-67e3-417c-be88-4e0a85ad75aa is going to be updated. [ 1025.414053] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.414335] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.414335] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.414831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.414831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.427052] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0010338f-67e3-417c-be88-4e0a85ad75aa in Status: IN_PROGRESS for 2s [ 1025.494181] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a938b55d-b711-4079-9f7b-f27235895480 in Status: SUCCESS [ 1025.494374] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.652540] env[65783]: INFO networking_nsxv3.common.synchronization [req-02a43d71-8342-451f-9c26-61fc9ecb2fe0 req-95d763ee-f650-455f-8804-3ab4ddeb0c25 tempest-MultipleCreateTestJSON-1108671505 tempest-MultipleCreateTestJSON-1108671505-project-member] Enqueued Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_members [ 1025.653167] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_members [ 1025.653615] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.653754] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.653818] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.654412] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.654412] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.654412] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.654609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.654609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.654677] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.654769] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.742548] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76: rpc.has_security_group_logging(os_id): False [ 1025.751110] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-831 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.751337] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-831" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.751462] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-831" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.751802] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-831" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.752076] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.752236] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.752352] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.752563] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.752739] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.752907] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1025.753087] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1025.753246] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1025.753380] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1025.753499] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1025.753608] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1025.753738] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1025.763728] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.763932] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.763932] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.764199] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.764325] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.764567] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.764651] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.764715] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.764878] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.764953] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.765150] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.765239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.765302] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.765456] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.765530] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.765778] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.765897] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.767271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.767271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.767271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.767271] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 is going to be updated. [ 1025.783926] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1025.784204] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1025.784904] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1025.784904] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-831" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.785636] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-b382ad0a-1833-409d-8d27-6726195bc924 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.785829] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-b382ad0a-1833-409d-8d27-6726195bc924" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.786160] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-b382ad0a-1833-409d-8d27-6726195bc924" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.786680] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-b382ad0a-1833-409d-8d27-6726195bc924" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.786864] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b382ad0a-1833-409d-8d27-6726195bc924',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.842215] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.842407] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.842477] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.842754] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.842985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.844514] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.844663] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.844756] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.844963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.845089] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.845366] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.845478] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.845522] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.845715] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.845819] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.845929] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1375c2-7b1e-420c-a8d1-1ccf5e01438b already deleted. [ 1025.846043] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.861645] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 in Status: IN_PROGRESS for 2s [ 1026.157046] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.290832] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.291446] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.291446] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.291693] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.291855] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.292013] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port b382ad0a-1833-409d-8d27-6726195bc924 not found, creating... [ 1026.292334] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.292566] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.292703] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.292972] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.293175] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.293537] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.293748] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.293915] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.297403] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.297672] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.297908] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: b382ad0a-1833-409d-8d27-6726195bc924 is going to be created. [ 1026.324468] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.324468] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.324658] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.324908] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.325178] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.325502] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-b382ad0a-1833-409d-8d27-6726195bc924" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.465529] env[65783]: INFO networking_nsxv3.common.synchronization [req-ec99b11b-94b8-4be2-99f2-f7de50745cee req-f44f20b9-f393-4b69-aabc-d0c3287b2cdc tempest-MultipleCreateTestJSON-1108671505 tempest-MultipleCreateTestJSON-1108671505-project-member] Enqueued Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_members [ 1026.466102] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_members [ 1026.466409] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.466504] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.659853] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.162598] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.162811] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.163366] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.163366] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.163603] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.163715] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 is going to be updated. [ 1027.177995] env[65783]: INFO networking_nsxv3.common.synchronization [req-48690ab9-1989-48a3-a76a-7e97931fe0f5 req-98365cda-3ffe-47c8-9147-13aa55758e0f service nova] Enqueued Resource ID: af1375c2-7b1e-420c-a8d1-1ccf5e01438b with Priority: HIGHEST for action security_group_rules [ 1027.179344] env[65783]: INFO networking_nsxv3.common.synchronization [req-48690ab9-1989-48a3-a76a-7e97931fe0f5 req-98365cda-3ffe-47c8-9147-13aa55758e0f service nova] Enqueued Resource ID: af1375c2-7b1e-420c-a8d1-1ccf5e01438b with Priority: HIGHEST for action security_group_members [ 1027.179344] env[65783]: INFO networking_nsxv3.common.synchronization [req-48690ab9-1989-48a3-a76a-7e97931fe0f5 req-98365cda-3ffe-47c8-9147-13aa55758e0f service nova] Enqueued Resource ID: b382ad0a-1833-409d-8d27-6726195bc924 with Priority: HIGHEST for action port [ 1027.182573] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1375c2-7b1e-420c-a8d1-1ccf5e01438b with Priority: HIGHEST for action security_group_rules [ 1027.182573] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1375c2-7b1e-420c-a8d1-1ccf5e01438b with Priority: HIGHEST for action security_group_members [ 1027.182573] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b382ad0a-1833-409d-8d27-6726195bc924 with Priority: HIGHEST for action port [ 1027.182573] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af1375c2-7b1e-420c-a8d1-1ccf5e01438b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.182573] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.182573] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.182573] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.182573] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af1375c2-7b1e-420c-a8d1-1ccf5e01438b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.185144] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1375c2-7b1e-420c-a8d1-1ccf5e01438b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.185144] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.185144] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.185144] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.185144] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.185144] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.185144] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.185144] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.185144] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.185144] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1375c2-7b1e-420c-a8d1-1ccf5e01438b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.185634] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-b382ad0a-1833-409d-8d27-6726195bc924 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.185634] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b382ad0a-1833-409d-8d27-6726195bc924" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.185736] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b382ad0a-1833-409d-8d27-6726195bc924" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.185865] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b382ad0a-1833-409d-8d27-6726195bc924" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.185940] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b382ad0a-1833-409d-8d27-6726195bc924',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.201641] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.201844] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.201929] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.202167] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.202294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.216508] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 in Status: IN_PROGRESS for 2s [ 1027.438525] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0010338f-67e3-417c-be88-4e0a85ad75aa in Status: SUCCESS [ 1027.438525] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0010338f-67e3-417c-be88-4e0a85ad75aa deletion is rescheduled due to dependency. [ 1027.438525] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.667852] env[65783]: INFO networking_nsxv3.common.synchronization [None req-759943e7-5df3-4f48-9711-32a288f4d5af None None] Enqueued Resource ID: 71d63684-d43b-4aa2-9864-371a8b148346 with Priority: HIGHEST for action port [ 1027.668446] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71d63684-d43b-4aa2-9864-371a8b148346 with Priority: HIGHEST for action port [ 1027.668785] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-71d63684-d43b-4aa2-9864-371a8b148346 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.668908] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71d63684-d43b-4aa2-9864-371a8b148346" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.668976] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71d63684-d43b-4aa2-9864-371a8b148346" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.669243] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71d63684-d43b-4aa2-9864-371a8b148346" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.669326] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71d63684-d43b-4aa2-9864-371a8b148346',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.687419] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af1375c2-7b1e-420c-a8d1-1ccf5e01438b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.688456] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1375c2-7b1e-420c-a8d1-1ccf5e01438b taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.688456] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.688979] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b382ad0a-1833-409d-8d27-6726195bc924 with status ACTIVE [ 1027.688979] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.689184] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.689184] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.689684] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.689684] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.689684] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.689867] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.689867] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.690097] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.690705] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.690705] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.690705] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.690994] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.690994] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.690994] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.691186] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b382ad0a-1833-409d-8d27-6726195bc924 is going to be updated. [ 1027.716504] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.716703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.716703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.716910] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.717060] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.717206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b382ad0a-1833-409d-8d27-6726195bc924" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.874959] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 in Status: SUCCESS [ 1027.875826] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.172264] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71d63684-d43b-4aa2-9864-371a8b148346 [ 1028.172573] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.172779] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.172779] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.173100] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.173100] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.173244] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71d63684-d43b-4aa2-9864-371a8b148346 already deleted. [ 1028.173434] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71d63684-d43b-4aa2-9864-371a8b148346" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.189452] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af1375c2-7b1e-420c-a8d1-1ccf5e01438b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.279331] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.279713] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.279713] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.279889] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.280064] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.693444] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.693935] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.693935] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.693935] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.694172] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.694172] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1375c2-7b1e-420c-a8d1-1ccf5e01438b is going to be created. [ 1028.727888] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.728057] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.728124] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.728384] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.728609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.738896] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1375c2-7b1e-420c-a8d1-1ccf5e01438b in Status: UNINITIALIZED for 2s [ 1028.782454] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.230738] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 in Status: IN_PROGRESS for 4s [ 1029.285712] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.787803] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1029.787803] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1030.752316] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1375c2-7b1e-420c-a8d1-1ccf5e01438b in Status: SUCCESS [ 1030.752751] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.752827] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.753926] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.754296] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.754452] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.754522] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.754723] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.754812] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.754923] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.755375] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('af1375c2-7b1e-420c-a8d1-1ccf5e01438b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.758387] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.758387] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.758387] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.758387] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.773771] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1030.774768] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.776979] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1030.820185] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.820185] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.820185] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.820185] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.831098] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.831624] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1030.831624] env[65783]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65783) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1030.831772] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1030.876974] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.876974] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.876974] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.877367] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.878370] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.878507] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1030.954899] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.955176] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.955176] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.955463] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.956017] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.956226] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1031.022923] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.023118] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.023215] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.023454] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.023717] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.023971] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:39. [ 1031.024397] env[65783]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'05d32358-32a3-497c-a1f6-14de2057f1b3', 'dccc2c0a-475d-4f38-ad2a-2e54cdca65b1', 'a938b55d-b711-4079-9f7b-f27235895480', '752cf951-e22b-4bfc-b89a-6766804d295f', 'c5516de4-7ca8-423d-ae28-4654dc2ae29c', '72614839-90ad-4218-8056-d4c6f35d8448', 'efd942bf-b305-4707-8084-1ac6b135c741', '2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76', 'a56944ee-f571-421e-aac3-fe1ac51a1fd9', 'd62819d6-c7c5-47a8-a028-a438cb9528b5', '8c81f8cb-609b-4496-9f07-b80abbe519f8', '9943d881-28bf-4885-906c-d360f9c2c3e7', 'b6e66254-5e43-437b-850b-825eaaa0cee1', '177e22b5-9104-44ad-8e54-e2d4da7915c9', '6432899c-b0aa-4285-971f-16ac27b1305b', 'de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb', '40fa215c-6810-4862-9ddc-1bca888b2ee5', 'cbc55d75-4ce5-409b-958a-48efef735829', 'c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47', '3bbf64d2-1030-46ae-99d0-42b29d7d0132', '5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40', '778e25c7-acbe-47ad-a052-4adb2729b152', '3672e01a-c2d7-4bab-8a43-04160e095ad1', 'e588ff7c-d45a-4b75-823e-f219eeb5e814', '9b8bb0e6-1d22-4e95-a649-fc4d3180195b', 'bbaf974c-75cf-4b48-a666-f75dfe105a74', '0010338f-67e3-417c-be88-4e0a85ad75aa', '74220b44-588c-49ac-81cc-e6ac2b7c6024', 'ca99b1a6-3702-4011-942b-06036fda2165', 'b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6', 'fdcea21f-f135-4ab1-9f28-d5be76c7c16b', 'c6dc57fb-f44d-4b26-87fe-bb8e4df202a8', 'b56f5230-554e-48f1-aef4-fcf2593b50d3', '21a0bbd4-6f51-4a42-b423-363e65f0247c', 'aaf15510-666a-49d9-9a20-6f398b7f8216', '527a6015-4311-4050-9945-7b4c6e602f59', '7998a549-f70e-4b58-992e-5c5ab6652711', '4a5d8777-50f6-4124-8014-838a921e8bd1', '044a26f5-b666-44c4-8c58-085d6cf0af26'} {{(pid=65783) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1031.024504] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1031.050473] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.050715] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.050851] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.051206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.051653] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.051653] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1031.051653] env[65783]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65783) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1031.051767] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1031.207036] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.207226] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.207271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.207671] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.208806] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.209240] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1031.209240] env[65783]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65783) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1031.209376] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1031.209421] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1031.209507] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/39 resources of Type:Security Group Rules [ 1031.209621] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 05d32358-32a3-497c-a1f6-14de2057f1b3 with Priority: HIGH for action security_group_rules [ 1031.209712] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 with Priority: HIGH for action security_group_rules [ 1031.209792] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a938b55d-b711-4079-9f7b-f27235895480 with Priority: HIGH for action security_group_rules [ 1031.209912] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 752cf951-e22b-4bfc-b89a-6766804d295f with Priority: HIGH for action security_group_rules [ 1031.210008] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c with Priority: HIGH for action security_group_rules [ 1031.210092] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 72614839-90ad-4218-8056-d4c6f35d8448 with Priority: HIGH for action security_group_rules [ 1031.210157] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGH for action security_group_rules [ 1031.210221] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGH for action security_group_rules [ 1031.210320] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGH for action security_group_rules [ 1031.210356] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 with Priority: HIGH for action security_group_rules [ 1031.210391] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGH for action security_group_rules [ 1031.210508] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGH for action security_group_rules [ 1031.210508] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b6e66254-5e43-437b-850b-825eaaa0cee1 with Priority: HIGH for action security_group_rules [ 1031.210575] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 with Priority: HIGH for action security_group_rules [ 1031.210609] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6432899c-b0aa-4285-971f-16ac27b1305b with Priority: HIGH for action security_group_rules [ 1031.210671] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb with Priority: HIGH for action security_group_rules [ 1031.210741] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 40fa215c-6810-4862-9ddc-1bca888b2ee5 with Priority: HIGH for action security_group_rules [ 1031.210789] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cbc55d75-4ce5-409b-958a-48efef735829 with Priority: HIGH for action security_group_rules [ 1031.210843] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 with Priority: HIGH for action security_group_rules [ 1031.210905] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGH for action security_group_rules [ 1031.211183] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.242070] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 in Status: SUCCESS [ 1031.242354] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.242562] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.242832] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.243084] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.243371] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.243503] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.243701] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.243793] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.243910] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.281658] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('af1375c2-7b1e-420c-a8d1-1ccf5e01438b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.747061] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.747283] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.747392] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.747567] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.771813] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.772222] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.772222] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.772403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.772503] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.772566] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.772678] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 is going to be updated. [ 1031.783970] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for af1375c2-7b1e-420c-a8d1-1ccf5e01438b: rpc.has_security_group_logging(os_id): False [ 1031.805392] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.805392] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.805392] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.805392] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.805668] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.805715] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.805812] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.805876] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.806047] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.806122] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.806208] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af1375c2-7b1e-420c-a8d1-1ccf5e01438b is going to be created. [ 1031.812173] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.812298] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.812379] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.812550] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.812686] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.822774] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 in Status: IN_PROGRESS for 2s [ 1031.880329] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.880520] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.880563] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.880832] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.880912] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.898496] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af1375c2-7b1e-420c-a8d1-1ccf5e01438b in Status: IN_PROGRESS for 2s [ 1032.670966] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1032.670966] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=2 [ 1032.671254] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05d32358-32a3-497c-a1f6-14de2057f1b3 with Priority: HIGH for action security_group_rules [ 1032.671322] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a938b55d-b711-4079-9f7b-f27235895480 with Priority: HIGH for action security_group_rules [ 1032.671866] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd942bf-b305-4707-8084-1ac6b135c741 with Priority: HIGH for action security_group_rules [ 1032.671866] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6432899c-b0aa-4285-971f-16ac27b1305b with Priority: HIGH for action security_group_rules [ 1032.671866] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 with Priority: HIGH for action security_group_rules [ 1032.671866] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 with Priority: HIGH for action security_group_rules [ 1032.671866] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc55d75-4ce5-409b-958a-48efef735829 with Priority: HIGH for action security_group_rules [ 1032.671866] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40fa215c-6810-4862-9ddc-1bca888b2ee5 with Priority: HIGH for action security_group_rules [ 1032.672145] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 with Priority: HIGH for action security_group_rules [ 1032.672145] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb with Priority: HIGH for action security_group_rules [ 1032.672145] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e66254-5e43-437b-850b-825eaaa0cee1 with Priority: HIGH for action security_group_rules [ 1032.672145] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 with Priority: HIGH for action security_group_rules [ 1032.672309] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGH for action security_group_rules [ 1032.672309] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 with Priority: HIGH for action security_group_rules [ 1032.672544] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGH for action security_group_rules [ 1032.672544] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72614839-90ad-4218-8056-d4c6f35d8448 with Priority: HIGH for action security_group_rules [ 1032.672544] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGH for action security_group_rules [ 1032.672696] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c with Priority: HIGH for action security_group_rules [ 1032.672696] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 with Priority: HIGH for action security_group_rules [ 1032.672787] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 752cf951-e22b-4bfc-b89a-6766804d295f with Priority: HIGH for action security_group_rules [ 1032.674058] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05d32358-32a3-497c-a1f6-14de2057f1b3 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.674058] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.674058] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.674058] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.674450] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05d32358-32a3-497c-a1f6-14de2057f1b3',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.675529] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a938b55d-b711-4079-9f7b-f27235895480 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.675694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.675799] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.676100] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.676238] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.677763] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efd942bf-b305-4707-8084-1ac6b135c741 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.677763] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.677763] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.677983] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.678420] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efd942bf-b305-4707-8084-1ac6b135c741',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.679111] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6432899c-b0aa-4285-971f-16ac27b1305b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.679225] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.679713] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.679713] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.679713] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6432899c-b0aa-4285-971f-16ac27b1305b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.680623] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.680743] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.680798] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.681595] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.681595] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bbf64d2-1030-46ae-99d0-42b29d7d0132',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.682569] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.682691] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.682759] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.682934] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.683077] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.683959] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbc55d75-4ce5-409b-958a-48efef735829 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.684118] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.684189] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.684339] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.684415] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbc55d75-4ce5-409b-958a-48efef735829',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.685408] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40fa215c-6810-4862-9ddc-1bca888b2ee5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.685537] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.685721] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.685918] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.685918] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40fa215c-6810-4862-9ddc-1bca888b2ee5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.687581] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-177e22b5-9104-44ad-8e54-e2d4da7915c9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.687581] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.687731] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.688446] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.688446] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('177e22b5-9104-44ad-8e54-e2d4da7915c9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.689137] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.689720] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.689831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.689961] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.690075] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.692342] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6e66254-5e43-437b-850b-825eaaa0cee1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.692440] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.692503] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.692729] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.692729] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6e66254-5e43-437b-850b-825eaaa0cee1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.693632] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9943d881-28bf-4885-906c-d360f9c2c3e7 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.693751] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.693751] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.693907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.693960] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9943d881-28bf-4885-906c-d360f9c2c3e7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.694760] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c81f8cb-609b-4496-9f07-b80abbe519f8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.694982] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.695057] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.695596] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.695596] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.696025] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d62819d6-c7c5-47a8-a028-a438cb9528b5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.696136] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.696187] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.696404] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.696404] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d62819d6-c7c5-47a8-a028-a438cb9528b5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.697503] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.697503] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.697503] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.697503] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.697503] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.698609] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72614839-90ad-4218-8056-d4c6f35d8448 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.698609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.698609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.698609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.698609] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72614839-90ad-4218-8056-d4c6f35d8448',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.699614] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.699614] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.699614] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.699850] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.699850] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.701198] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5516de4-7ca8-423d-ae28-4654dc2ae29c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.701198] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.701198] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.701198] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.701198] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5516de4-7ca8-423d-ae28-4654dc2ae29c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.701900] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.701900] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.701900] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.701900] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.702296] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dccc2c0a-475d-4f38-ad2a-2e54cdca65b1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.702666] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-752cf951-e22b-4bfc-b89a-6766804d295f taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.702774] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.702822] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.702940] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.703052] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('752cf951-e22b-4bfc-b89a-6766804d295f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.206295] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a938b55d-b711-4079-9f7b-f27235895480 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.206713] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.206713] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.206713] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.206861] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.206953] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.207022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.207176] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.207351] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.207454] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.207550] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.212469] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c81f8cb-609b-4496-9f07-b80abbe519f8 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.212469] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.212469] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.212469] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.212469] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.212469] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.212469] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.212469] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.212469] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.212469] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.212469] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.271894] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.272238] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.272238] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.272423] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.284341] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.284552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.286279] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.286458] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.287458] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.287608] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.288594] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.288755] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.289807] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.289954] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.290853] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.290963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.292090] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.292220] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.293253] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.293404] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.294377] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.294565] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.295691] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.295851] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.296951] env[65783]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1033.297633] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.297828] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.298997] env[65783]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1033.299097] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.299255] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.300071] env[65783]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1033.301167] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.301167] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.302602] env[65783]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1033.303153] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.303296] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.307050] env[65783]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1033.307846] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.307846] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.312156] env[65783]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1033.312616] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.312801] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.324504] env[65783]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1033.324504] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.324504] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.333283] env[65783]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1033.333892] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.334170] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bbf64d2-1030-46ae-99d0-42b29d7d0132 is going to be deleted. [ 1033.336373] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.336373] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.375341] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.375749] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 is going to be deleted. [ 1033.376854] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.378025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.416899] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.417140] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5516de4-7ca8-423d-ae28-4654dc2ae29c is going to be deleted. [ 1033.422907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.423507] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.456760] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.457028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.478034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.478230] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efd942bf-b305-4707-8084-1ac6b135c741 is going to be deleted. [ 1033.479358] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.479556] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.517554] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.517822] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.521775] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.521968] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d62819d6-c7c5-47a8-a028-a438cb9528b5 is going to be deleted. [ 1033.523068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.523410] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.539660] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.540155] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.575736] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.575945] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72614839-90ad-4218-8056-d4c6f35d8448 is going to be deleted. [ 1033.577553] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.577553] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.620438] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.620438] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.620707] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.620957] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6432899c-b0aa-4285-971f-16ac27b1305b is going to be deleted. [ 1033.626616] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.627025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.678101] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.678602] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.712599] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.712693] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6e66254-5e43-437b-850b-825eaaa0cee1 is going to be deleted. [ 1033.713893] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.714169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.714853] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.714853] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 is going to be deleted. [ 1033.715315] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.715713] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.717763] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a938b55d-b711-4079-9f7b-f27235895480 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.717763] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.717763] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.717763] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.717763] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.717763] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.718412] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.718412] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.718412] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.718412] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.718412] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a938b55d-b711-4079-9f7b-f27235895480 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.718412] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.718608] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.718608] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.718788] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.718848] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.718883] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.718997] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.719095] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.719209] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.719249] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.720524] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.815650] env[65783]: INFO networking_nsxv3.common.synchronization [None req-780ffbdb-d395-483c-b988-d96f6ab4eaac tempest-AttachVolumeNegativeTest-1814624860 tempest-AttachVolumeNegativeTest-1814624860-project-member] Enqueued Resource ID: 99e0c417-31bf-428f-9d83-2ec769f78d5e with Priority: HIGHEST for action security_group_rules [ 1033.817411] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99e0c417-31bf-428f-9d83-2ec769f78d5e with Priority: HIGHEST for action security_group_rules [ 1033.818824] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99e0c417-31bf-428f-9d83-2ec769f78d5e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.818824] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.818824] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.819128] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.819128] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99e0c417-31bf-428f-9d83-2ec769f78d5e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.824568] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.824715] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47 is going to be deleted. [ 1033.829518] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.829861] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.860246] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 in Status: SUCCESS [ 1033.860246] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 deletion is rescheduled due to dependency. [ 1033.860246] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.891222] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.891381] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.909903] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.910114] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb is going to be deleted. [ 1033.912175] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.912460] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.946937] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.947150] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.948579] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.948732] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.950018] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af1375c2-7b1e-420c-a8d1-1ccf5e01438b in Status: SUCCESS [ 1033.950018] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.973473] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.973648] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.978499] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.978499] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9943d881-28bf-4885-906c-d360f9c2c3e7 is going to be deleted. [ 1033.978499] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.978833] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.049920] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.050147] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.057168] env[65783]: INFO networking_nsxv3.common.synchronization [None req-428630d6-ca27-4e30-9848-2986874d56b2 tempest-AttachVolumeNegativeTest-1814624860 tempest-AttachVolumeNegativeTest-1814624860-project-member] Enqueued Resource ID: 99e0c417-31bf-428f-9d83-2ec769f78d5e with Priority: HIGHEST for action security_group_rules [ 1034.057854] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99e0c417-31bf-428f-9d83-2ec769f78d5e with Priority: HIGHEST for action security_group_rules [ 1034.058293] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99e0c417-31bf-428f-9d83-2ec769f78d5e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.058402] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.062811] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.062811] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 177e22b5-9104-44ad-8e54-e2d4da7915c9 is going to be deleted. [ 1034.066035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.066035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.121910] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.122279] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.124281] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.124442] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbc55d75-4ce5-409b-958a-48efef735829 is going to be deleted. [ 1034.125755] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.126011] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.200194] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.200194] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 752cf951-e22b-4bfc-b89a-6766804d295f is going to be deleted. [ 1034.200722] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.201042] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.222871] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a938b55d-b711-4079-9f7b-f27235895480: rpc.has_security_group_logging(os_id): False [ 1034.224123] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c81f8cb-609b-4496-9f07-b80abbe519f8: rpc.has_security_group_logging(os_id): False [ 1034.271103] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.271347] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.273559] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.273732] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.274588] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.274683] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.275595] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.275711] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40fa215c-6810-4862-9ddc-1bca888b2ee5 is going to be deleted. [ 1034.277119] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.277119] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.278408] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.278507] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.279770] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.279889] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.313086] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.313370] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dccc2c0a-475d-4f38-ad2a-2e54cdca65b1 is going to be deleted. [ 1034.314366] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.314588] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.344734] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.344926] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05d32358-32a3-497c-a1f6-14de2057f1b3 is going to be deleted. [ 1034.345895] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.346128] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.346224] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.346362] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bbf64d2-1030-46ae-99d0-42b29d7d0132" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.346524] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.346678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.346753] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.346865] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.347423] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.347589] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.347671] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.347790] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5516de4-7ca8-423d-ae28-4654dc2ae29c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.347918] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.348076] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.348154] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.348269] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efd942bf-b305-4707-8084-1ac6b135c741" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.348965] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.348965] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.348965] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.348965] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d62819d6-c7c5-47a8-a028-a438cb9528b5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.348965] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.348965] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.349344] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.349344] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6e66254-5e43-437b-850b-825eaaa0cee1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.349344] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.349472] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.349472] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.350068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6432899c-b0aa-4285-971f-16ac27b1305b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.350068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.350068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.350068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.350068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72614839-90ad-4218-8056-d4c6f35d8448" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.350303] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.350303] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.350303] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.350394] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.350552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.350705] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.350705] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.350834] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0c605ba-a0f1-45a0-ae22-2ba6ebce2e47" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.350930] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.351096] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.351177] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.351296] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de6ae5fc-fc8b-4c6e-b7ad-b3e3fd290abb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.351453] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.351625] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.368992] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.369295] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.419969] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.420330] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.420494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.420580] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.420821] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.421340] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.421340] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.421493] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.421493] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.422424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.422424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.422739] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.422739] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.422898] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.423457] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.423457] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.423457] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a938b55d-b711-4079-9f7b-f27235895480 is going to be updated. [ 1034.424678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.424678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.424678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.424866] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-177e22b5-9104-44ad-8e54-e2d4da7915c9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.424956] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.425077] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.425158] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.425288] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9943d881-28bf-4885-906c-d360f9c2c3e7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.425412] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.425893] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.425992] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.426138] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbc55d75-4ce5-409b-958a-48efef735829" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.426342] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.426401] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.436133] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.436295] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.441136] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.441238] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.483150] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.483150] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.490429] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.491403] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.491403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.491403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.491403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.491403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.491673] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 is going to be updated. [ 1034.492593] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.492825] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.492874] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.492970] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99e0c417-31bf-428f-9d83-2ec769f78d5e already deleted. [ 1034.493326] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.493326] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.493555] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.493555] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.493712] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-752cf951-e22b-4bfc-b89a-6766804d295f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.493930] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.495489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.495489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.495489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40fa215c-6810-4862-9ddc-1bca888b2ee5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.495489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.495489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.495489] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99e0c417-31bf-428f-9d83-2ec769f78d5e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.495489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.495755] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.495755] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.495861] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dccc2c0a-475d-4f38-ad2a-2e54cdca65b1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.500412] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.500412] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.500412] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.500683] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.500683] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.500786] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05d32358-32a3-497c-a1f6-14de2057f1b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.645540] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.645814] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.645814] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.645987] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.646157] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.689589] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.689589] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.689589] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.689589] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.689589] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.707109] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a938b55d-b711-4079-9f7b-f27235895480 in Status: IN_PROGRESS for 2s [ 1034.764342] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: IN_PROGRESS for 2s [ 1035.019218] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.019407] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.019487] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.019664] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.019754] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.019850] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99e0c417-31bf-428f-9d83-2ec769f78d5e already deleted. [ 1035.019934] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.725950] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a938b55d-b711-4079-9f7b-f27235895480 in Status: SUCCESS [ 1036.726224] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.777509] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: SUCCESS [ 1036.777739] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.058511] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1039.058821] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1039.632810] env[65783]: INFO networking_nsxv3.common.synchronization [None req-9854554d-23f7-47a8-81de-e6b0ca025a72 None None] Enqueued Resource ID: 21018dd3-d047-485a-99ff-95369610f567 with Priority: HIGHEST for action port [ 1039.633483] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21018dd3-d047-485a-99ff-95369610f567 with Priority: HIGHEST for action port [ 1039.633802] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-21018dd3-d047-485a-99ff-95369610f567 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.633925] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21018dd3-d047-485a-99ff-95369610f567" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.633989] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21018dd3-d047-485a-99ff-95369610f567" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.634833] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21018dd3-d047-485a-99ff-95369610f567" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.634919] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21018dd3-d047-485a-99ff-95369610f567',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.139668] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 21018dd3-d047-485a-99ff-95369610f567 [ 1040.139668] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.139668] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.139668] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.139668] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.139668] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.139668] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:21018dd3-d047-485a-99ff-95369610f567 already deleted. [ 1040.139668] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21018dd3-d047-485a-99ff-95369610f567" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.437271] env[65783]: INFO networking_nsxv3.common.synchronization [None req-cfabd599-a3a5-49ac-ab54-f5ef53e8be19 tempest-AttachInterfacesTestJSON-1497773155 tempest-AttachInterfacesTestJSON-1497773155-project-member] Enqueued Resource ID: 8b9cb981-343d-4db5-9714-846a4e345d4b with Priority: HIGHEST for action security_group_rules [ 1040.437271] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b9cb981-343d-4db5-9714-846a4e345d4b with Priority: HIGHEST for action security_group_rules [ 1040.437271] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b9cb981-343d-4db5-9714-846a4e345d4b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.437271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.437271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.437271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.437879] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b9cb981-343d-4db5-9714-846a4e345d4b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.594117] env[65783]: INFO networking_nsxv3.common.synchronization [None req-91cc0c88-95e0-4c12-aa7b-af9c5500d5a1 tempest-AttachInterfacesTestJSON-1497773155 tempest-AttachInterfacesTestJSON-1497773155-project-member] Enqueued Resource ID: 8b9cb981-343d-4db5-9714-846a4e345d4b with Priority: HIGHEST for action security_group_rules [ 1040.595413] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b9cb981-343d-4db5-9714-846a4e345d4b with Priority: HIGHEST for action security_group_rules [ 1040.595413] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b9cb981-343d-4db5-9714-846a4e345d4b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.595413] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.962914] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.962914] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.962914] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.963456] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.963456] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.963574] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b9cb981-343d-4db5-9714-846a4e345d4b already deleted. [ 1040.963639] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.963788] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.963948] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.964054] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b9cb981-343d-4db5-9714-846a4e345d4b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.489629] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.489917] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.489917] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.490103] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.490218] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.490280] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b9cb981-343d-4db5-9714-846a4e345d4b already deleted. [ 1041.490359] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.940114] env[65783]: INFO networking_nsxv3.common.synchronization [req-8c5e77b6-bfa8-4a71-92e6-ac3f7bbf26ef req-4e68f1e2-0c7f-493b-9e67-348ee0be80b3 tempest-ServerActionsTestOtherB-29394606 tempest-ServerActionsTestOtherB-29394606-project-member] Enqueued Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_members [ 1041.940666] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_members [ 1041.940971] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c81f8cb-609b-4496-9f07-b80abbe519f8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.941104] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.941199] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.942306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.942306] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.942306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.942306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.942306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.942306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.942306] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.994584] env[65783]: INFO networking_nsxv3.common.synchronization [None req-49630bb5-bedd-4f41-9872-de5a6ffdc481 None None] Enqueued Resource ID: 23096877-30b4-4c29-b563-567ebbddddfb with Priority: HIGHEST for action port [ 1041.995347] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23096877-30b4-4c29-b563-567ebbddddfb with Priority: HIGHEST for action port [ 1041.995669] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-23096877-30b4-4c29-b563-567ebbddddfb taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.997363] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23096877-30b4-4c29-b563-567ebbddddfb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.997474] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23096877-30b4-4c29-b563-567ebbddddfb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.997716] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23096877-30b4-4c29-b563-567ebbddddfb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.997804] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23096877-30b4-4c29-b563-567ebbddddfb',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.446694] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.446694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.446694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.446694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.446694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.446694] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.446694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.446694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.446694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.446694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.446694] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 is going to be updated. [ 1042.472807] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.472947] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.473620] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.473620] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.473620] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.482384] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: IN_PROGRESS for 2s [ 1042.501849] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23096877-30b4-4c29-b563-567ebbddddfb [ 1042.501849] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.501849] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.501849] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.502340] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.502447] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.502504] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23096877-30b4-4c29-b563-567ebbddddfb already deleted. [ 1042.502593] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23096877-30b4-4c29-b563-567ebbddddfb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.031701] env[65783]: INFO networking_nsxv3.common.synchronization [req-1e56d52b-d381-4efa-b926-9a59a079800c req-0893f135-3a99-4771-8ce1-91a7b8b0f48c tempest-DeleteServersTestJSON-1456685968 tempest-DeleteServersTestJSON-1456685968-project-member] Enqueued Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 1043.032351] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 1043.032708] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.032829] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.032896] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.034413] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.034594] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.034708] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.034777] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.034927] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.035016] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.035983] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.175986] env[65783]: INFO networking_nsxv3.common.synchronization [None req-207da29e-15bd-4a2f-899f-d8eb6867cd87 None None] Enqueued Resource ID: 7599c14e-f6cc-423f-ab21-f5f3f6e70af5 with Priority: HIGHEST for action port [ 1043.176335] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7599c14e-f6cc-423f-ab21-f5f3f6e70af5 with Priority: HIGHEST for action port [ 1043.176641] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-7599c14e-f6cc-423f-ab21-f5f3f6e70af5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.176762] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7599c14e-f6cc-423f-ab21-f5f3f6e70af5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.176822] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7599c14e-f6cc-423f-ab21-f5f3f6e70af5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.177311] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7599c14e-f6cc-423f-ab21-f5f3f6e70af5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.177311] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7599c14e-f6cc-423f-ab21-f5f3f6e70af5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.538384] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.538862] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.538862] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.538964] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.539043] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.539355] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.539524] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.539629] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.539898] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.540073] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.540210] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 is going to be deleted. [ 1043.571918] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.572096] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.572150] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.572334] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.572425] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.572517] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.685075] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7599c14e-f6cc-423f-ab21-f5f3f6e70af5 [ 1043.685075] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.685075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.685075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.685075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.685075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.685075] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7599c14e-f6cc-423f-ab21-f5f3f6e70af5 already deleted. [ 1043.685075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7599c14e-f6cc-423f-ab21-f5f3f6e70af5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.733902] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-131 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.733902] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-131" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.733902] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-131" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.733902] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-131" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.734298] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.734298] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.734409] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.734577] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.734715] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.734916] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1043.735182] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1043.735326] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1043.735439] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1043.735550] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1043.735654] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1043.735782] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1043.762171] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1043.762358] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1043.762495] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1043.762672] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-131" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.763038] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-c4e814dc-0974-4f84-9c52-5feb163ebd78 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.763225] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-c4e814dc-0974-4f84-9c52-5feb163ebd78" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.763367] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-c4e814dc-0974-4f84-9c52-5feb163ebd78" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.763704] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-c4e814dc-0974-4f84-9c52-5feb163ebd78" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.763843] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4e814dc-0974-4f84-9c52-5feb163ebd78',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.266714] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.266948] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.267087] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.267383] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.267538] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.267693] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port c4e814dc-0974-4f84-9c52-5feb163ebd78 not found, creating... [ 1044.267961] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.268137] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.268391] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.268474] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.268596] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.268878] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.269044] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.269159] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.269621] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.272937] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.272937] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: c4e814dc-0974-4f84-9c52-5feb163ebd78 is going to be created. [ 1044.323581] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.323581] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.323581] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.323581] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.323823] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.324076] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-c4e814dc-0974-4f84-9c52-5feb163ebd78" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.497089] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: SUCCESS [ 1044.497089] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 deletion is rescheduled due to dependency. [ 1044.497855] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.012031] env[65783]: INFO networking_nsxv3.common.synchronization [req-1e56d52b-d381-4efa-b926-9a59a079800c req-e9a0605b-e8b5-4517-8c57-8e42d71964b9 service nova] Enqueued Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_rules [ 1045.012031] env[65783]: INFO networking_nsxv3.common.synchronization [req-1e56d52b-d381-4efa-b926-9a59a079800c req-e9a0605b-e8b5-4517-8c57-8e42d71964b9 service nova] Enqueued Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 1045.012031] env[65783]: INFO networking_nsxv3.common.synchronization [req-1e56d52b-d381-4efa-b926-9a59a079800c req-e9a0605b-e8b5-4517-8c57-8e42d71964b9 service nova] Enqueued Resource ID: c4e814dc-0974-4f84-9c52-5feb163ebd78 with Priority: HIGHEST for action port [ 1045.012031] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_rules [ 1045.012031] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 1045.012031] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4e814dc-0974-4f84-9c52-5feb163ebd78 with Priority: HIGHEST for action port [ 1045.018035] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.018035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.018035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.018035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.018035] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.018035] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.018035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.018035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.018035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.018035] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.018035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.018035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.018035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.018035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.018035] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.019969] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4e814dc-0974-4f84-9c52-5feb163ebd78 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.019969] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4e814dc-0974-4f84-9c52-5feb163ebd78" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.019969] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4e814dc-0974-4f84-9c52-5feb163ebd78" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.019969] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4e814dc-0974-4f84-9c52-5feb163ebd78" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.019969] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4e814dc-0974-4f84-9c52-5feb163ebd78',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.371995] env[65783]: INFO networking_nsxv3.common.synchronization [None req-3e88afd9-71a7-4a5c-a0d9-fa9b5468b59a tempest-ServerActionsTestJSON-316964864 tempest-ServerActionsTestJSON-316964864-project-member] Enqueued Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGHEST for action security_group_rules [ 1045.373324] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGHEST for action security_group_rules [ 1045.374130] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-316d910a-b054-4723-942e-7f84e9154008 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.374349] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.374482] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.375057] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.375447] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.522344] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.522529] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.522759] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.524233] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4e814dc-0974-4f84-9c52-5feb163ebd78 with status ACTIVE [ 1045.524600] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.524689] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.524804] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.524918] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.525018] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.525358] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.525489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.525489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.525653] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.525702] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.525891] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.525982] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.526060] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.527274] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.527467] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.527467] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4e814dc-0974-4f84-9c52-5feb163ebd78 is going to be updated. [ 1045.551782] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.552129] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.552225] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.552534] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.552675] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.552862] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4e814dc-0974-4f84-9c52-5feb163ebd78" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.582130] env[65783]: INFO networking_nsxv3.common.synchronization [None req-94ba224b-58d2-44ec-be39-aa2f846f6212 None None] Enqueued Resource ID: d7df4f60-a2c2-43d6-809b-11a4f7f89cad with Priority: HIGHEST for action port [ 1045.582318] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7df4f60-a2c2-43d6-809b-11a4f7f89cad with Priority: HIGHEST for action port [ 1045.582784] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7df4f60-a2c2-43d6-809b-11a4f7f89cad taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.582977] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7df4f60-a2c2-43d6-809b-11a4f7f89cad" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.583096] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7df4f60-a2c2-43d6-809b-11a4f7f89cad" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.583450] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7df4f60-a2c2-43d6-809b-11a4f7f89cad" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.583590] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7df4f60-a2c2-43d6-809b-11a4f7f89cad',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.628893] env[65783]: INFO networking_nsxv3.common.synchronization [None req-7f0342ea-da44-4bcb-b3e5-88db54f95427 tempest-ServerActionsTestJSON-316964864 tempest-ServerActionsTestJSON-316964864-project-member] Enqueued Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGHEST for action security_group_rules [ 1045.629820] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGHEST for action security_group_rules [ 1045.630346] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-316d910a-b054-4723-942e-7f84e9154008 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.630491] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.899231] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.899231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.899231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.899231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.899231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.899231] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 316d910a-b054-4723-942e-7f84e9154008 already deleted. [ 1045.899231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.899231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.899231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.899231] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.029736] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.088102] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7df4f60-a2c2-43d6-809b-11a4f7f89cad [ 1046.088102] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.088102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.088102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.088102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.088102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.088102] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7df4f60-a2c2-43d6-809b-11a4f7f89cad already deleted. [ 1046.088487] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7df4f60-a2c2-43d6-809b-11a4f7f89cad" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.419134] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.419300] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.419383] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.419560] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.419651] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.419764] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 316d910a-b054-4723-942e-7f84e9154008 already deleted. [ 1046.419830] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.533352] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.533614] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.533614] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.533834] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.533921] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.534066] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 is going to be created. [ 1046.561415] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.562232] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.562232] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.562232] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.562232] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.572686] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: UNINITIALIZED for 2s [ 1047.448230] env[65783]: INFO networking_nsxv3.common.synchronization [None req-c1e98b35-ff69-47de-a8ad-b3c7bd9aee9f None None] Enqueued Resource ID: 6c0044c7-f121-4ac8-adb7-fb4ea690061e with Priority: HIGHEST for action port [ 1047.448969] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c0044c7-f121-4ac8-adb7-fb4ea690061e with Priority: HIGHEST for action port [ 1047.450706] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c0044c7-f121-4ac8-adb7-fb4ea690061e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.450706] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c0044c7-f121-4ac8-adb7-fb4ea690061e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.450706] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c0044c7-f121-4ac8-adb7-fb4ea690061e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.450706] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c0044c7-f121-4ac8-adb7-fb4ea690061e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.450706] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c0044c7-f121-4ac8-adb7-fb4ea690061e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.952892] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6c0044c7-f121-4ac8-adb7-fb4ea690061e [ 1047.953295] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.953454] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.953524] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.953767] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.953848] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.953965] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6c0044c7-f121-4ac8-adb7-fb4ea690061e already deleted. [ 1047.954058] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c0044c7-f121-4ac8-adb7-fb4ea690061e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.583773] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: SUCCESS [ 1048.584072] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.584177] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.584391] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.584577] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.584696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.584747] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.584987] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.584987] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.585095] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.585168] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.089607] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.089607] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.089607] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.089607] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.089607] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.089607] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.089607] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.089607] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.089607] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.089607] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.089607] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.089607] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.089607] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.089607] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.089607] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.089607] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.091663] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.091663] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.091663] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.091663] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.091663] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.593718] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a56944ee-f571-421e-aac3-fe1ac51a1fd9: rpc.has_security_group_logging(os_id): False [ 1049.615303] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.615526] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.615610] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.615879] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.615975] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.616234] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.616338] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.616410] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.616564] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.616632] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.616807] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.616898] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.616959] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.617119] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.617178] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.617356] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.617490] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.617490] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.617634] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.617705] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.617858] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 is going to be created. [ 1049.679441] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.682392] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.682392] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.682392] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.682392] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.705443] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: IN_PROGRESS for 2s [ 1050.290685] env[65783]: INFO networking_nsxv3.common.synchronization [req-a1fe5911-a678-4b19-9f19-a5a35483331e req-f97d8661-7dfd-40d9-9993-00199c129994 tempest-AttachVolumeTestJSON-999763968 tempest-AttachVolumeTestJSON-999763968-project-member] Enqueued Resource ID: 4a5d8777-50f6-4124-8014-838a921e8bd1 with Priority: HIGHEST for action security_group_members [ 1050.291404] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a5d8777-50f6-4124-8014-838a921e8bd1 with Priority: HIGHEST for action security_group_members [ 1050.291786] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a5d8777-50f6-4124-8014-838a921e8bd1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.291911] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a5d8777-50f6-4124-8014-838a921e8bd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.291990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a5d8777-50f6-4124-8014-838a921e8bd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.293097] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a5d8777-50f6-4124-8014-838a921e8bd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.293357] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.293551] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.293672] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.293949] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.294383] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.294383] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a5d8777-50f6-4124-8014-838a921e8bd1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.801443] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.802022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.802179] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.802579] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.833041] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.833426] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.833535] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.833566] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.833763] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.833844] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.833933] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a5d8777-50f6-4124-8014-838a921e8bd1 is going to be updated. [ 1050.861127] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.861906] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.861906] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.861906] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.861906] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.872095] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a5d8777-50f6-4124-8014-838a921e8bd1 in Status: IN_PROGRESS for 2s [ 1050.922851] env[65783]: INFO networking_nsxv3.common.synchronization [None req-734c4d26-3f95-4151-9b28-e613b1fceffb None None] Enqueued Resource ID: 43a0dceb-3afb-47bd-8890-2eb7515893c4 with Priority: HIGHEST for action port [ 1050.922851] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a0dceb-3afb-47bd-8890-2eb7515893c4 with Priority: HIGHEST for action port [ 1050.923480] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-43a0dceb-3afb-47bd-8890-2eb7515893c4 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.923480] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43a0dceb-3afb-47bd-8890-2eb7515893c4" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.923480] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43a0dceb-3afb-47bd-8890-2eb7515893c4" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.923673] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43a0dceb-3afb-47bd-8890-2eb7515893c4" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.923811] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43a0dceb-3afb-47bd-8890-2eb7515893c4',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.102874] env[65783]: INFO networking_nsxv3.common.synchronization [req-de562ae7-c03c-48ec-8f40-18ab3f156c21 req-7df0d463-80d1-47f0-84a7-a80b5d25612a tempest-ServerTagsTestJSON-2143161080 tempest-ServerTagsTestJSON-2143161080-project-member] Enqueued Resource ID: 7dbaa62b-695c-43df-8e6f-4d18d6d47de5 with Priority: HIGHEST for action security_group_members [ 1051.104213] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dbaa62b-695c-43df-8e6f-4d18d6d47de5 with Priority: HIGHEST for action security_group_members [ 1051.104415] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.104548] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.104622] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.104889] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.105061] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.105272] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.105272] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.105393] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.105478] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.105575] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dbaa62b-695c-43df-8e6f-4d18d6d47de5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.429223] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 43a0dceb-3afb-47bd-8890-2eb7515893c4 [ 1051.429532] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.430529] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.430529] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.430529] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.430529] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.430529] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:43a0dceb-3afb-47bd-8890-2eb7515893c4 already deleted. [ 1051.430529] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43a0dceb-3afb-47bd-8890-2eb7515893c4" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.464437] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-532 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.466816] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-532" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.466816] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-532" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.466816] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-532" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.466816] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.466816] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.466816] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.466816] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.466816] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.466816] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1051.466816] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1051.466816] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1051.466816] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1051.467308] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1051.467308] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1051.467308] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1051.566460] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1051.566558] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.099 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1051.566645] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1051.566833] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-532" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.567205] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-92c5d7f8-f9bf-43a9-b827-f02a33eba7d0 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.567414] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-92c5d7f8-f9bf-43a9-b827-f02a33eba7d0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.567540] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-92c5d7f8-f9bf-43a9-b827-f02a33eba7d0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.567866] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-92c5d7f8-f9bf-43a9-b827-f02a33eba7d0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.568008] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92c5d7f8-f9bf-43a9-b827-f02a33eba7d0',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.608359] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.608517] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.608592] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.608845] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.608933] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.609187] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.609187] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.609302] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.609393] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.609465] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.609553] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dbaa62b-695c-43df-8e6f-4d18d6d47de5 already deleted. [ 1051.609736] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.721373] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: SUCCESS [ 1051.721676] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.070345] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.070736] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.070736] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.070987] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.071150] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.071304] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 92c5d7f8-f9bf-43a9-b827-f02a33eba7d0 not found, creating... [ 1052.071571] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.071742] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.071863] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.072142] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.072282] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.072561] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.072728] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.072831] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.073050] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.073187] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.073367] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 92c5d7f8-f9bf-43a9-b827-f02a33eba7d0 is going to be created. [ 1052.094407] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.094664] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.094786] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.095092] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.095323] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.095552] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-92c5d7f8-f9bf-43a9-b827-f02a33eba7d0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.717553] env[65783]: INFO networking_nsxv3.common.synchronization [req-de562ae7-c03c-48ec-8f40-18ab3f156c21 req-d4e0d468-5b89-4ae5-af55-5d87ed571734 service nova] Enqueued Resource ID: 7dbaa62b-695c-43df-8e6f-4d18d6d47de5 with Priority: HIGHEST for action security_group_rules [ 1052.717735] env[65783]: INFO networking_nsxv3.common.synchronization [req-de562ae7-c03c-48ec-8f40-18ab3f156c21 req-d4e0d468-5b89-4ae5-af55-5d87ed571734 service nova] Enqueued Resource ID: 7dbaa62b-695c-43df-8e6f-4d18d6d47de5 with Priority: HIGHEST for action security_group_members [ 1052.717912] env[65783]: INFO networking_nsxv3.common.synchronization [req-de562ae7-c03c-48ec-8f40-18ab3f156c21 req-d4e0d468-5b89-4ae5-af55-5d87ed571734 service nova] Enqueued Resource ID: 92c5d7f8-f9bf-43a9-b827-f02a33eba7d0 with Priority: HIGHEST for action port [ 1052.718445] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dbaa62b-695c-43df-8e6f-4d18d6d47de5 with Priority: HIGHEST for action security_group_rules [ 1052.719521] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dbaa62b-695c-43df-8e6f-4d18d6d47de5 with Priority: HIGHEST for action security_group_members [ 1052.719830] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92c5d7f8-f9bf-43a9-b827-f02a33eba7d0 with Priority: HIGHEST for action port [ 1052.720361] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dbaa62b-695c-43df-8e6f-4d18d6d47de5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.720531] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.720634] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.720915] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.721100] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dbaa62b-695c-43df-8e6f-4d18d6d47de5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.723178] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.723425] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.723514] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.723919] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.723919] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.724108] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.724108] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.724204] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.724367] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.724431] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dbaa62b-695c-43df-8e6f-4d18d6d47de5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.725623] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-92c5d7f8-f9bf-43a9-b827-f02a33eba7d0 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.725723] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92c5d7f8-f9bf-43a9-b827-f02a33eba7d0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.725804] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92c5d7f8-f9bf-43a9-b827-f02a33eba7d0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.725994] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92c5d7f8-f9bf-43a9-b827-f02a33eba7d0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.726062] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92c5d7f8-f9bf-43a9-b827-f02a33eba7d0',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.881727] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a5d8777-50f6-4124-8014-838a921e8bd1 in Status: SUCCESS [ 1052.881941] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a5d8777-50f6-4124-8014-838a921e8bd1 deletion is rescheduled due to dependency. [ 1052.882068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a5d8777-50f6-4124-8014-838a921e8bd1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.224006] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.224273] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.227300] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7dbaa62b-695c-43df-8e6f-4d18d6d47de5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.228587] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 92c5d7f8-f9bf-43a9-b827-f02a33eba7d0 with status ACTIVE [ 1053.228796] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.228922] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.229449] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.229696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.229792] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.230018] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.230149] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.230252] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.230358] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.230410] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.230617] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.230729] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.230818] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.230944] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.231091] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.231091] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 92c5d7f8-f9bf-43a9-b827-f02a33eba7d0 is going to be updated. [ 1053.255441] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.255725] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.255725] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.255861] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.256013] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.256173] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92c5d7f8-f9bf-43a9-b827-f02a33eba7d0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.565694] env[65783]: INFO networking_nsxv3.common.synchronization [req-84bde57a-6cea-4ae3-98f5-99247cd46f18 req-b919df69-7eaa-43d4-8dd5-ce9b7e2ff8c6 tempest-ServerActionsTestOtherA-298845163 tempest-ServerActionsTestOtherA-298845163-project-member] Enqueued Resource ID: aaf15510-666a-49d9-9a20-6f398b7f8216 with Priority: HIGHEST for action security_group_members [ 1053.566234] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaf15510-666a-49d9-9a20-6f398b7f8216 with Priority: HIGHEST for action security_group_members [ 1053.566534] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaf15510-666a-49d9-9a20-6f398b7f8216 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.566653] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.566717] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.566915] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.567082] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.567181] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.567242] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.567387] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.567473] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.567585] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aaf15510-666a-49d9-9a20-6f398b7f8216',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.733134] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7dbaa62b-695c-43df-8e6f-4d18d6d47de5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.906477] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-678 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.907303] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-678" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.907303] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-678" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.907303] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-678" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.907303] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.907513] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.907513] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.908134] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.908134] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.908304] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1053.908442] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1053.908547] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1053.908651] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1053.908757] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1053.909800] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1053.909800] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1053.938027] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1053.938027] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1053.938164] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1053.938347] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-678" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.939062] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-ab03f5bb-a9ba-42df-bbe4-d8a3b6acd401 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.939062] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-ab03f5bb-a9ba-42df-bbe4-d8a3b6acd401" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.939062] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-ab03f5bb-a9ba-42df-bbe4-d8a3b6acd401" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.939883] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-ab03f5bb-a9ba-42df-bbe4-d8a3b6acd401" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.939883] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab03f5bb-a9ba-42df-bbe4-d8a3b6acd401',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.069890] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aaf15510-666a-49d9-9a20-6f398b7f8216',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.236945] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.237289] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.237289] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.237414] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.237506] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.237603] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dbaa62b-695c-43df-8e6f-4d18d6d47de5 is going to be created. [ 1054.264587] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.264587] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.264587] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.264587] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.264841] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.278528] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dbaa62b-695c-43df-8e6f-4d18d6d47de5 in Status: UNINITIALIZED for 2s [ 1054.442622] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.444033] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.444033] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.444033] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.444033] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.444033] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port ab03f5bb-a9ba-42df-bbe4-d8a3b6acd401 not found, creating... [ 1054.444033] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.444033] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.444353] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.444353] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.444485] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.444763] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.444916] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.445052] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.445265] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.445400] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.445536] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: ab03f5bb-a9ba-42df-bbe4-d8a3b6acd401 is going to be created. [ 1054.469951] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.469951] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.470172] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.470363] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.470635] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.470886] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-ab03f5bb-a9ba-42df-bbe4-d8a3b6acd401" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.572432] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aaf15510-666a-49d9-9a20-6f398b7f8216',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.074969] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.076242] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.076392] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.076732] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.076901] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.077044] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aaf15510-666a-49d9-9a20-6f398b7f8216 is going to be updated. [ 1055.110036] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.110036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.110036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.110036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.110036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.120547] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaf15510-666a-49d9-9a20-6f398b7f8216 in Status: IN_PROGRESS for 2s [ 1055.186679] env[65783]: INFO networking_nsxv3.common.synchronization [req-84bde57a-6cea-4ae3-98f5-99247cd46f18 req-c6ace01b-37c0-4b1c-9dc7-81697cc8ad68 service nova] Enqueued Resource ID: aaf15510-666a-49d9-9a20-6f398b7f8216 with Priority: HIGHEST for action security_group_rules [ 1055.186803] env[65783]: INFO networking_nsxv3.common.synchronization [req-84bde57a-6cea-4ae3-98f5-99247cd46f18 req-c6ace01b-37c0-4b1c-9dc7-81697cc8ad68 service nova] Enqueued Resource ID: aaf15510-666a-49d9-9a20-6f398b7f8216 with Priority: HIGHEST for action security_group_members [ 1055.186931] env[65783]: INFO networking_nsxv3.common.synchronization [req-84bde57a-6cea-4ae3-98f5-99247cd46f18 req-c6ace01b-37c0-4b1c-9dc7-81697cc8ad68 service nova] Enqueued Resource ID: ab03f5bb-a9ba-42df-bbe4-d8a3b6acd401 with Priority: HIGHEST for action port [ 1055.187550] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaf15510-666a-49d9-9a20-6f398b7f8216 with Priority: HIGHEST for action security_group_rules [ 1055.187628] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaf15510-666a-49d9-9a20-6f398b7f8216 with Priority: HIGHEST for action security_group_members [ 1055.187727] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab03f5bb-a9ba-42df-bbe4-d8a3b6acd401 with Priority: HIGHEST for action port [ 1055.188011] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aaf15510-666a-49d9-9a20-6f398b7f8216 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.188144] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.188203] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.188410] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.188488] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aaf15510-666a-49d9-9a20-6f398b7f8216',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.189329] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaf15510-666a-49d9-9a20-6f398b7f8216 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.189422] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.189727] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab03f5bb-a9ba-42df-bbe4-d8a3b6acd401 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.189727] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab03f5bb-a9ba-42df-bbe4-d8a3b6acd401" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.189901] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab03f5bb-a9ba-42df-bbe4-d8a3b6acd401" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.189938] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab03f5bb-a9ba-42df-bbe4-d8a3b6acd401" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.189999] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab03f5bb-a9ba-42df-bbe4-d8a3b6acd401',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.693264] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab03f5bb-a9ba-42df-bbe4-d8a3b6acd401 with status ACTIVE [ 1055.693264] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.693634] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.693634] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.693742] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.693831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.694097] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.694254] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.694377] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.694604] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.694685] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.694954] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.695225] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.695225] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.695392] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.695487] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.695603] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab03f5bb-a9ba-42df-bbe4-d8a3b6acd401 is going to be updated. [ 1055.697303] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaf15510-666a-49d9-9a20-6f398b7f8216 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.697447] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.723035] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.723399] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.723501] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.723728] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.723864] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.724038] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab03f5bb-a9ba-42df-bbe4-d8a3b6acd401" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.015522] env[65783]: INFO networking_nsxv3.common.synchronization [req-642ffcbd-3e65-4d9b-9896-2dedfd81e07a req-3f8d258c-0fbc-4d26-b458-7b164b7ae2a3 tempest-AttachVolumeNegativeTest-1814624860 tempest-AttachVolumeNegativeTest-1814624860-project-member] Enqueued Resource ID: 99e0c417-31bf-428f-9d83-2ec769f78d5e with Priority: HIGHEST for action security_group_members [ 1056.016087] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99e0c417-31bf-428f-9d83-2ec769f78d5e with Priority: HIGHEST for action security_group_members [ 1056.016463] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-99e0c417-31bf-428f-9d83-2ec769f78d5e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.016600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.016665] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.016924] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.017199] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.017199] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.017333] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.017410] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.017470] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.017570] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99e0c417-31bf-428f-9d83-2ec769f78d5e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.292890] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dbaa62b-695c-43df-8e6f-4d18d6d47de5 in Status: SUCCESS [ 1056.293180] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.293465] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.293800] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.294095] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.294330] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.294440] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.294760] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.294760] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.294906] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.295066] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7dbaa62b-695c-43df-8e6f-4d18d6d47de5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.377648] env[65783]: INFO networking_nsxv3.common.synchronization [req-512a0a8d-2b83-493c-ab78-07b3b55f0b92 req-2344a5fd-9c7e-400c-a111-8391df5842a6 tempest-ServersNegativeTestJSON-460036087 tempest-ServersNegativeTestJSON-460036087-project-member] Enqueued Resource ID: a938b55d-b711-4079-9f7b-f27235895480 with Priority: HIGHEST for action security_group_members [ 1056.378303] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a938b55d-b711-4079-9f7b-f27235895480 with Priority: HIGHEST for action security_group_members [ 1056.378631] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a938b55d-b711-4079-9f7b-f27235895480 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.378810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.378810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.379022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.379181] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.379279] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.379390] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.379515] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.379572] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.379669] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.386234] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-552 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.387281] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-552" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.387383] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-552" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.387990] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-552" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.387990] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.388192] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.388326] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.388583] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.388871] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.388981] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1056.389086] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1056.389196] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1056.389344] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1056.389451] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1056.389564] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1056.389713] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1056.412375] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1056.413517] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1056.413517] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1056.413517] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-552" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.413517] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-d6d70bc9-e4ba-4775-9452-626cf247086d taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.413839] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-d6d70bc9-e4ba-4775-9452-626cf247086d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.413881] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-d6d70bc9-e4ba-4775-9452-626cf247086d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.414290] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-d6d70bc9-e4ba-4775-9452-626cf247086d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.415081] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6d70bc9-e4ba-4775-9452-626cf247086d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.520773] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.520957] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.521018] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.521263] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.521360] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.521571] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.521673] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.521737] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.521888] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.521963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.522059] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99e0c417-31bf-428f-9d83-2ec769f78d5e already deleted. [ 1056.522142] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.798751] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.799158] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.799158] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.799364] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.799475] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.799579] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.799679] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.799858] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.799938] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.800040] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.800195] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.800284] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.800339] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.800500] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.800675] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.800772] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.800824] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.801012] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.801128] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.801292] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.801438] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7dbaa62b-695c-43df-8e6f-4d18d6d47de5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.881969] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.882170] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.882170] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.882433] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.882489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.882702] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.882798] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.882862] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.883023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.883095] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.883179] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a938b55d-b711-4079-9f7b-f27235895480 is going to be updated. [ 1056.914301] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.914472] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.914545] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.914762] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.914896] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.917777] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.917923] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.918055] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.918312] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.918452] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.918622] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port d6d70bc9-e4ba-4775-9452-626cf247086d not found, creating... [ 1056.918878] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.919046] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.919162] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.919373] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.919509] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.919787] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.919941] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.920068] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.920329] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.920426] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.920566] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: d6d70bc9-e4ba-4775-9452-626cf247086d is going to be created. [ 1056.925324] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a938b55d-b711-4079-9f7b-f27235895480 in Status: IN_PROGRESS for 2s [ 1056.940167] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.940382] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.940509] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.940871] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.941121] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.941361] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-d6d70bc9-e4ba-4775-9452-626cf247086d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.132228] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaf15510-666a-49d9-9a20-6f398b7f8216 in Status: SUCCESS [ 1057.133048] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.133048] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.133048] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.133181] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.133330] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.133330] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.133533] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.133655] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.133711] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aaf15510-666a-49d9-9a20-6f398b7f8216',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.304827] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7dbaa62b-695c-43df-8e6f-4d18d6d47de5: rpc.has_security_group_logging(os_id): False [ 1057.323622] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.323809] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.323845] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.324083] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.324179] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.324414] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.324534] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.324600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.324768] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.324838] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.325027] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.325122] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.325184] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.325328] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.325403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.325615] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.325707] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.325768] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.325983] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.326083] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.326172] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dbaa62b-695c-43df-8e6f-4d18d6d47de5 is going to be created. [ 1057.395146] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.397499] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.397499] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.397499] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.397499] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.409074] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dbaa62b-695c-43df-8e6f-4d18d6d47de5 in Status: IN_PROGRESS for 2s [ 1057.637453] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aaf15510-666a-49d9-9a20-6f398b7f8216',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.693165] env[65783]: INFO networking_nsxv3.common.synchronization [req-642ffcbd-3e65-4d9b-9896-2dedfd81e07a req-07eab273-6d2f-49a0-b5b2-05fe6e6ed180 service nova] Enqueued Resource ID: 99e0c417-31bf-428f-9d83-2ec769f78d5e with Priority: HIGHEST for action security_group_rules [ 1057.693451] env[65783]: INFO networking_nsxv3.common.synchronization [req-642ffcbd-3e65-4d9b-9896-2dedfd81e07a req-07eab273-6d2f-49a0-b5b2-05fe6e6ed180 service nova] Enqueued Resource ID: 99e0c417-31bf-428f-9d83-2ec769f78d5e with Priority: HIGHEST for action security_group_members [ 1057.693558] env[65783]: INFO networking_nsxv3.common.synchronization [req-642ffcbd-3e65-4d9b-9896-2dedfd81e07a req-07eab273-6d2f-49a0-b5b2-05fe6e6ed180 service nova] Enqueued Resource ID: d6d70bc9-e4ba-4775-9452-626cf247086d with Priority: HIGHEST for action port [ 1057.694114] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99e0c417-31bf-428f-9d83-2ec769f78d5e with Priority: HIGHEST for action security_group_rules [ 1057.694250] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99e0c417-31bf-428f-9d83-2ec769f78d5e with Priority: HIGHEST for action security_group_members [ 1057.694333] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6d70bc9-e4ba-4775-9452-626cf247086d with Priority: HIGHEST for action port [ 1057.694676] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99e0c417-31bf-428f-9d83-2ec769f78d5e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.694797] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.694860] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.695316] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.695476] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99e0c417-31bf-428f-9d83-2ec769f78d5e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.696916] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-99e0c417-31bf-428f-9d83-2ec769f78d5e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.697147] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.697267] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.697402] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.697555] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.697648] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.697716] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.697920] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.698057] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.698158] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99e0c417-31bf-428f-9d83-2ec769f78d5e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.698954] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6d70bc9-e4ba-4775-9452-626cf247086d taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.699093] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6d70bc9-e4ba-4775-9452-626cf247086d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.699499] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6d70bc9-e4ba-4775-9452-626cf247086d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.699499] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6d70bc9-e4ba-4775-9452-626cf247086d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.699499] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6d70bc9-e4ba-4775-9452-626cf247086d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.140475] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aaf15510-666a-49d9-9a20-6f398b7f8216',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.201959] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-99e0c417-31bf-428f-9d83-2ec769f78d5e taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.202148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.202403] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99e0c417-31bf-428f-9d83-2ec769f78d5e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.204369] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6d70bc9-e4ba-4775-9452-626cf247086d with status ACTIVE [ 1058.204369] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.204369] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.204369] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.204369] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.204369] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.205151] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.205276] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.205344] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.205582] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.205620] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.205811] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.205906] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.205964] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.206134] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.206204] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.206286] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6d70bc9-e4ba-4775-9452-626cf247086d is going to be updated. [ 1058.229164] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.229312] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.229376] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.229613] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.229943] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.230179] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6d70bc9-e4ba-4775-9452-626cf247086d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.642777] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.642967] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.643069] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.643334] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.643495] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.643613] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aaf15510-666a-49d9-9a20-6f398b7f8216 is going to be updated. [ 1058.673848] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.674038] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.674102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.674393] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.674658] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.687232] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaf15510-666a-49d9-9a20-6f398b7f8216 in Status: IN_PROGRESS for 2s [ 1058.708773] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99e0c417-31bf-428f-9d83-2ec769f78d5e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.938409] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a938b55d-b711-4079-9f7b-f27235895480 in Status: SUCCESS [ 1058.938602] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a938b55d-b711-4079-9f7b-f27235895480 deletion is rescheduled due to dependency. [ 1058.938717] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.211748] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.212391] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.212391] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.212391] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.212391] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.212391] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99e0c417-31bf-428f-9d83-2ec769f78d5e is going to be created. [ 1059.235533] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.235692] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.235747] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.235966] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.236145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.246591] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99e0c417-31bf-428f-9d83-2ec769f78d5e in Status: UNINITIALIZED for 2s [ 1059.421112] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dbaa62b-695c-43df-8e6f-4d18d6d47de5 in Status: SUCCESS [ 1059.421477] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.501154] env[65783]: INFO networking_nsxv3.common.synchronization [req-9fef25f7-0c18-497b-89d8-774ef3b6b1f2 req-79ceb8d5-d33c-4670-9c23-b7f128321bf1 tempest-DeleteServersTestJSON-1456685968 tempest-DeleteServersTestJSON-1456685968-project-member] Enqueued Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 1059.501651] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 1059.501924] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.502051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.503345] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.503345] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.503345] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.503345] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.503345] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.503345] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.503345] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.503345] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.007039] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.007039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.007039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.007325] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.007525] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.007828] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.008395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.008395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.008395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.008567] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.008598] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 is going to be updated. [ 1060.041471] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.041551] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.041748] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.041829] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.041963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.053049] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: IN_PROGRESS for 2s [ 1060.697392] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaf15510-666a-49d9-9a20-6f398b7f8216 in Status: SUCCESS [ 1060.697692] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.698736] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.698736] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.698736] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.698736] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.698736] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.698736] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.698736] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.699194] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.699194] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aaf15510-666a-49d9-9a20-6f398b7f8216',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.202045] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aaf15510-666a-49d9-9a20-6f398b7f8216',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.259465] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99e0c417-31bf-428f-9d83-2ec769f78d5e in Status: SUCCESS [ 1061.259673] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.259867] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.260713] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.260713] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.260713] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.260713] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.260713] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.260713] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.261116] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.261116] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99e0c417-31bf-428f-9d83-2ec769f78d5e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.704843] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aaf15510-666a-49d9-9a20-6f398b7f8216: rpc.has_security_group_logging(os_id): False [ 1061.729333] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.729333] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.729333] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.729333] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.751208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.751208] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.751208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.751208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.751208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.751208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.751208] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aaf15510-666a-49d9-9a20-6f398b7f8216 is going to be updated. [ 1061.763940] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99e0c417-31bf-428f-9d83-2ec769f78d5e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.810800] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.810978] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.811029] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.811231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.811422] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.835486] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aaf15510-666a-49d9-9a20-6f398b7f8216 in Status: IN_PROGRESS for 2s [ 1062.063725] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: SUCCESS [ 1062.063906] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 deletion is rescheduled due to dependency. [ 1062.064028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.266984] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99e0c417-31bf-428f-9d83-2ec769f78d5e: rpc.has_security_group_logging(os_id): False [ 1062.288885] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.289128] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.289128] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.289344] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.289669] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.290149] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.290325] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.290639] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.290706] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.290771] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.290890] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99e0c417-31bf-428f-9d83-2ec769f78d5e is going to be created. [ 1062.372912] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.373019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.373118] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.373420] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.373622] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.387677] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99e0c417-31bf-428f-9d83-2ec769f78d5e in Status: IN_PROGRESS for 2s [ 1063.268373] env[65783]: INFO networking_nsxv3.common.synchronization [req-9b0118a6-925e-4d7e-ae28-51e99864d234 req-d7194547-2d34-4b3c-91ec-525c1a6585ff tempest-ServerTagsTestJSON-2143161080 tempest-ServerTagsTestJSON-2143161080-project-member] Enqueued Resource ID: 7dbaa62b-695c-43df-8e6f-4d18d6d47de5 with Priority: HIGHEST for action security_group_members [ 1063.269046] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dbaa62b-695c-43df-8e6f-4d18d6d47de5 with Priority: HIGHEST for action security_group_members [ 1063.269341] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.270091] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.270091] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.270091] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.270091] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.270262] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.270262] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.270384] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.270463] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.270557] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dbaa62b-695c-43df-8e6f-4d18d6d47de5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.773806] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.774048] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.774155] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.774424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.774560] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.774769] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.774869] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.774930] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.775105] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.775175] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.775261] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dbaa62b-695c-43df-8e6f-4d18d6d47de5 is going to be updated. [ 1063.812069] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.812222] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.812295] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.812521] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.812671] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.825623] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dbaa62b-695c-43df-8e6f-4d18d6d47de5 in Status: IN_PROGRESS for 2s [ 1063.849644] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aaf15510-666a-49d9-9a20-6f398b7f8216 in Status: SUCCESS [ 1063.849881] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.399595] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99e0c417-31bf-428f-9d83-2ec769f78d5e in Status: SUCCESS [ 1064.399960] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.430153] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-738 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.430494] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-738" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.430494] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-738" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.430766] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-738" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.431042] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.431206] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.431347] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.431575] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.431715] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.431917] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1065.432041] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1065.432150] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1065.432259] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1065.432368] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1065.432472] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1065.432601] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1065.452704] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1065.452875] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1065.453018] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1065.453250] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-738" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.453532] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-eba2c4b7-13de-4fe3-95fb-86d9494cd97a taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.453705] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-eba2c4b7-13de-4fe3-95fb-86d9494cd97a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.453824] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-eba2c4b7-13de-4fe3-95fb-86d9494cd97a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.454087] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-eba2c4b7-13de-4fe3-95fb-86d9494cd97a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.454230] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eba2c4b7-13de-4fe3-95fb-86d9494cd97a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.835880] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dbaa62b-695c-43df-8e6f-4d18d6d47de5 in Status: SUCCESS [ 1065.836078] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dbaa62b-695c-43df-8e6f-4d18d6d47de5 deletion is rescheduled due to dependency. [ 1065.836195] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.956551] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.956810] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.956939] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.957251] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.957402] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.957691] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.957850] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.957967] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.958201] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.958333] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.958646] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.958807] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.958920] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.959481] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.959635] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.959779] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: eba2c4b7-13de-4fe3-95fb-86d9494cd97a is going to be updated. [ 1065.981052] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.981052] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.981252] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.981406] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.981598] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.981814] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-eba2c4b7-13de-4fe3-95fb-86d9494cd97a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.678046] env[65783]: INFO networking_nsxv3.common.synchronization [req-dd28a89e-adcf-4d0f-adcf-9a1eb4b2a940 req-63350d95-1539-41ea-8269-e0de00df534a service nova] Enqueued Resource ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b with Priority: HIGHEST for action security_group_rules [ 1066.678046] env[65783]: INFO networking_nsxv3.common.synchronization [req-dd28a89e-adcf-4d0f-adcf-9a1eb4b2a940 req-63350d95-1539-41ea-8269-e0de00df534a service nova] Enqueued Resource ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b with Priority: HIGHEST for action security_group_members [ 1066.678046] env[65783]: INFO networking_nsxv3.common.synchronization [req-dd28a89e-adcf-4d0f-adcf-9a1eb4b2a940 req-63350d95-1539-41ea-8269-e0de00df534a service nova] Enqueued Resource ID: eba2c4b7-13de-4fe3-95fb-86d9494cd97a with Priority: HIGHEST for action port [ 1066.678775] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b with Priority: HIGHEST for action security_group_rules [ 1066.678976] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b with Priority: HIGHEST for action security_group_members [ 1066.679158] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eba2c4b7-13de-4fe3-95fb-86d9494cd97a with Priority: HIGHEST for action port [ 1066.679576] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdcea21f-f135-4ab1-9f28-d5be76c7c16b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.679731] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.680228] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.680522] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.680619] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdcea21f-f135-4ab1-9f28-d5be76c7c16b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.681562] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.681683] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.681756] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.681937] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.682115] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.682214] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.683528] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.683886] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.684016] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.684341] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdcea21f-f135-4ab1-9f28-d5be76c7c16b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.687667] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-eba2c4b7-13de-4fe3-95fb-86d9494cd97a taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.687667] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eba2c4b7-13de-4fe3-95fb-86d9494cd97a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.687806] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eba2c4b7-13de-4fe3-95fb-86d9494cd97a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.687899] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eba2c4b7-13de-4fe3-95fb-86d9494cd97a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.688033] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eba2c4b7-13de-4fe3-95fb-86d9494cd97a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.189634] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.189788] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.190068] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fdcea21f-f135-4ab1-9f28-d5be76c7c16b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.191096] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eba2c4b7-13de-4fe3-95fb-86d9494cd97a with status ACTIVE [ 1067.191352] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.191572] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.191667] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.191903] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.192010] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.192195] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.192295] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.192358] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.192573] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.192629] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.192773] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.192882] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.192924] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.193067] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.193141] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.193223] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eba2c4b7-13de-4fe3-95fb-86d9494cd97a is going to be updated. [ 1067.217316] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.217516] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.217560] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.217830] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.218065] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.218240] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eba2c4b7-13de-4fe3-95fb-86d9494cd97a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.695629] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fdcea21f-f135-4ab1-9f28-d5be76c7c16b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.198045] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.198220] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.198220] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.198505] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.198600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.198705] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b is going to be updated. [ 1068.228582] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.228805] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.228805] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.229011] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.229162] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.238945] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b in Status: IN_PROGRESS for 2s [ 1068.305236] env[65783]: INFO networking_nsxv3.common.synchronization [req-66f33a34-b6dd-4538-a327-3cdde5d15cd2 req-126a287e-02a3-481f-89f7-2fd7af06e517 tempest-AttachInterfacesTestJSON-1497773155 tempest-AttachInterfacesTestJSON-1497773155-project-member] Enqueued Resource ID: 8b9cb981-343d-4db5-9714-846a4e345d4b with Priority: HIGHEST for action security_group_members [ 1068.305949] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b9cb981-343d-4db5-9714-846a4e345d4b with Priority: HIGHEST for action security_group_members [ 1068.306311] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9cb981-343d-4db5-9714-846a4e345d4b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.306463] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.306524] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.306800] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.306971] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.307090] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.307149] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.307309] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.307400] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.307491] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b9cb981-343d-4db5-9714-846a4e345d4b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.642021] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.642156] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.642198] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.642963] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.642963] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.642963] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.643234] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.643527] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.643527] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.643635] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1068.643755] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1068.643864] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1068.643973] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1068.644097] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1068.644206] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1068.644334] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1068.663551] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1068.663733] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1068.663871] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1068.664056] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.664368] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-1426fd1f-0507-498d-9a05-9bce1efd861a taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.664560] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-1426fd1f-0507-498d-9a05-9bce1efd861a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.664682] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-1426fd1f-0507-498d-9a05-9bce1efd861a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.664995] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-1426fd1f-0507-498d-9a05-9bce1efd861a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.665154] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1426fd1f-0507-498d-9a05-9bce1efd861a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.810375] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.810375] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.810866] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.810866] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.810866] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.810992] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.811109] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.811198] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.811336] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.811423] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.811834] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b9cb981-343d-4db5-9714-846a4e345d4b already deleted. [ 1068.811834] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.167211] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.167468] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.167572] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.167870] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.168029] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.168186] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 1426fd1f-0507-498d-9a05-9bce1efd861a not found, creating... [ 1069.168445] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.168717] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.168717] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.168934] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.169080] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.169357] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.169528] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.169662] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.169876] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.170015] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.170161] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 1426fd1f-0507-498d-9a05-9bce1efd861a is going to be created. [ 1069.191027] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.191027] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.191027] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.191250] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.191473] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.191681] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-1426fd1f-0507-498d-9a05-9bce1efd861a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.919955] env[65783]: INFO networking_nsxv3.common.synchronization [req-66f33a34-b6dd-4538-a327-3cdde5d15cd2 req-050c8e96-a908-45a7-9bf5-a5bc50b7bab8 service nova] Enqueued Resource ID: 8b9cb981-343d-4db5-9714-846a4e345d4b with Priority: HIGHEST for action security_group_rules [ 1069.920236] env[65783]: INFO networking_nsxv3.common.synchronization [req-66f33a34-b6dd-4538-a327-3cdde5d15cd2 req-050c8e96-a908-45a7-9bf5-a5bc50b7bab8 service nova] Enqueued Resource ID: 8b9cb981-343d-4db5-9714-846a4e345d4b with Priority: HIGHEST for action security_group_members [ 1069.920296] env[65783]: INFO networking_nsxv3.common.synchronization [req-66f33a34-b6dd-4538-a327-3cdde5d15cd2 req-050c8e96-a908-45a7-9bf5-a5bc50b7bab8 service nova] Enqueued Resource ID: 1426fd1f-0507-498d-9a05-9bce1efd861a with Priority: HIGHEST for action port [ 1069.920886] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b9cb981-343d-4db5-9714-846a4e345d4b with Priority: HIGHEST for action security_group_rules [ 1069.921139] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b9cb981-343d-4db5-9714-846a4e345d4b with Priority: HIGHEST for action security_group_members [ 1069.921180] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1426fd1f-0507-498d-9a05-9bce1efd861a with Priority: HIGHEST for action port [ 1069.921453] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b9cb981-343d-4db5-9714-846a4e345d4b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.921600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.921667] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.921877] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.921999] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b9cb981-343d-4db5-9714-846a4e345d4b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.922829] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9cb981-343d-4db5-9714-846a4e345d4b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.922939] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.923083] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.923216] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.923364] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.923485] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.923584] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.923717] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.923795] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.923903] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b9cb981-343d-4db5-9714-846a4e345d4b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.925082] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-1426fd1f-0507-498d-9a05-9bce1efd861a taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.925275] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1426fd1f-0507-498d-9a05-9bce1efd861a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.925344] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1426fd1f-0507-498d-9a05-9bce1efd861a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.925861] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1426fd1f-0507-498d-9a05-9bce1efd861a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.925930] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1426fd1f-0507-498d-9a05-9bce1efd861a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.248712] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b in Status: SUCCESS [ 1070.249021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.249234] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.249496] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.249734] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.249904] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.249981] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.250197] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.250264] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.250350] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.250444] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fdcea21f-f135-4ab1-9f28-d5be76c7c16b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.427697] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9cb981-343d-4db5-9714-846a4e345d4b taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.427823] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.428131] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1426fd1f-0507-498d-9a05-9bce1efd861a with status ACTIVE [ 1070.428304] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.428421] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.428545] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.428814] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.428959] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.429159] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.429269] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.429340] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.429471] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.429557] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.429735] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.429821] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.429887] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.430020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.430106] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.430167] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1426fd1f-0507-498d-9a05-9bce1efd861a is going to be updated. [ 1070.431475] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b9cb981-343d-4db5-9714-846a4e345d4b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.454656] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.454819] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.454892] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.455133] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.455289] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.455456] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1426fd1f-0507-498d-9a05-9bce1efd861a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.699259] env[65783]: INFO networking_nsxv3.common.synchronization [req-dceb1314-8664-4f28-b55a-39d2b8f9a3dc req-a5e5b947-39ae-4662-8c71-0a1f10e807a0 tempest-ServerActionsTestJSON-316964864 tempest-ServerActionsTestJSON-316964864-project-member] Enqueued Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGHEST for action security_group_members [ 1070.700244] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGHEST for action security_group_members [ 1070.700878] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-316d910a-b054-4723-942e-7f84e9154008 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.701092] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.701181] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.701490] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.701680] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.701786] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.701857] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.702053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.702161] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.702257] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.752952] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fdcea21f-f135-4ab1-9f28-d5be76c7c16b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.933280] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b9cb981-343d-4db5-9714-846a4e345d4b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.098858] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.099032] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.099124] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.099530] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.099863] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.100094] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.100212] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.100429] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.100655] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.100864] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1071.101052] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1071.101128] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1071.101247] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1071.101399] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1071.101597] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1071.101753] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1071.124765] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1071.124994] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1071.125167] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1071.125372] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.125736] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-e7eece2d-f24b-4fcf-b1d8-a232af2c0021 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.125917] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-e7eece2d-f24b-4fcf-b1d8-a232af2c0021" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.126105] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-e7eece2d-f24b-4fcf-b1d8-a232af2c0021" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.126501] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-e7eece2d-f24b-4fcf-b1d8-a232af2c0021" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.126594] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7eece2d-f24b-4fcf-b1d8-a232af2c0021',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.204049] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.204266] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.204346] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.204625] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.204712] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.204916] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.205036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.205083] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.205237] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.205312] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.205519] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 316d910a-b054-4723-942e-7f84e9154008 already deleted. [ 1071.205519] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.254916] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fdcea21f-f135-4ab1-9f28-d5be76c7c16b: rpc.has_security_group_logging(os_id): False [ 1071.275553] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.275553] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.275553] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.275808] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.301289] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.301681] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.301797] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.301835] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.302636] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.302636] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.302636] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b is going to be updated. [ 1071.366544] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.366748] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.366797] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.367020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.367186] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.381796] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b in Status: IN_PROGRESS for 2s [ 1071.435333] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.435566] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.435566] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.435793] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.435882] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.435978] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b9cb981-343d-4db5-9714-846a4e345d4b is going to be created. [ 1071.480484] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.480694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.480694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.480865] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.481038] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.493486] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b9cb981-343d-4db5-9714-846a4e345d4b in Status: UNINITIALIZED for 2s [ 1071.630239] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.630491] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.631147] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.631147] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.631147] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.631304] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port e7eece2d-f24b-4fcf-b1d8-a232af2c0021 not found, creating... [ 1071.631601] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.631767] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.631911] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.632180] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.632333] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.632644] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.632829] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.632958] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.633204] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.633348] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.633544] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: e7eece2d-f24b-4fcf-b1d8-a232af2c0021 is going to be created. [ 1071.655582] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.655895] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.655895] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.656124] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.656376] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.656611] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-e7eece2d-f24b-4fcf-b1d8-a232af2c0021" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.381092] env[65783]: INFO networking_nsxv3.common.synchronization [req-dceb1314-8664-4f28-b55a-39d2b8f9a3dc req-adb41108-7f25-465f-80cb-e55d32a189d8 service nova] Enqueued Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGHEST for action security_group_rules [ 1072.381516] env[65783]: INFO networking_nsxv3.common.synchronization [req-dceb1314-8664-4f28-b55a-39d2b8f9a3dc req-adb41108-7f25-465f-80cb-e55d32a189d8 service nova] Enqueued Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGHEST for action security_group_members [ 1072.381516] env[65783]: INFO networking_nsxv3.common.synchronization [req-dceb1314-8664-4f28-b55a-39d2b8f9a3dc req-adb41108-7f25-465f-80cb-e55d32a189d8 service nova] Enqueued Resource ID: e7eece2d-f24b-4fcf-b1d8-a232af2c0021 with Priority: HIGHEST for action port [ 1072.381908] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGHEST for action security_group_rules [ 1072.383382] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGHEST for action security_group_members [ 1072.383541] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7eece2d-f24b-4fcf-b1d8-a232af2c0021 with Priority: HIGHEST for action port [ 1072.383828] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-316d910a-b054-4723-942e-7f84e9154008 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.383959] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.384059] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.384711] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.384711] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.385950] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-316d910a-b054-4723-942e-7f84e9154008 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.385950] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.386159] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.386194] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.386379] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.386449] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.386498] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.386641] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.389109] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.389109] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.389109] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7eece2d-f24b-4fcf-b1d8-a232af2c0021 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.390624] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7eece2d-f24b-4fcf-b1d8-a232af2c0021" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.390736] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7eece2d-f24b-4fcf-b1d8-a232af2c0021" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.390970] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7eece2d-f24b-4fcf-b1d8-a232af2c0021" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.391078] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7eece2d-f24b-4fcf-b1d8-a232af2c0021',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.893722] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.894875] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-316d910a-b054-4723-942e-7f84e9154008 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.894994] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.895195] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e7eece2d-f24b-4fcf-b1d8-a232af2c0021 with status ACTIVE [ 1072.895318] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.895438] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.895506] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.895705] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.895969] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.896186] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.896290] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.896349] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.896526] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.896608] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.896792] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.896883] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.896944] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.897168] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.897245] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.897331] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e7eece2d-f24b-4fcf-b1d8-a232af2c0021 is going to be updated. [ 1072.921750] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.921992] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.921992] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.922184] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.922320] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.922476] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7eece2d-f24b-4fcf-b1d8-a232af2c0021" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.246700] env[65783]: INFO networking_nsxv3.common.synchronization [req-63904635-3e9a-4795-a139-76e566af587d req-55c0416b-bd7f-4696-9f2c-304350268e20 tempest-ListServersNegativeTestJSON-1635349101 tempest-ListServersNegativeTestJSON-1635349101-project-member] Enqueued Resource ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 with Priority: HIGHEST for action security_group_members [ 1073.247162] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 with Priority: HIGHEST for action security_group_members [ 1073.247602] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-acedd9dc-9634-46d8-93d5-54ad3add17a5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.247744] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.247870] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.248149] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.248318] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.248422] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.248486] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.248649] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.248734] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.248828] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.399381] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.405508] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b in Status: SUCCESS [ 1073.406737] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.508718] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b9cb981-343d-4db5-9714-846a4e345d4b in Status: SUCCESS [ 1073.508962] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.509215] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.509414] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.509576] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.509736] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.509772] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.509905] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.509970] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.510060] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.510164] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b9cb981-343d-4db5-9714-846a4e345d4b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.642190] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-930 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.642190] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-930" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.642190] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-930" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.642190] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-930" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.642679] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.644212] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.644212] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.644212] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.644212] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.644212] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1073.644212] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1073.644212] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1073.644610] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1073.644816] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1073.645976] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1073.646162] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1073.671861] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1073.672643] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1073.672643] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1073.672643] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-930" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.673296] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-2b9f08a0-53d5-41f1-9780-2a30d0c7d529 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.673296] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-2b9f08a0-53d5-41f1-9780-2a30d0c7d529" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.673510] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-2b9f08a0-53d5-41f1-9780-2a30d0c7d529" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.673973] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-2b9f08a0-53d5-41f1-9780-2a30d0c7d529" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.674205] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b9f08a0-53d5-41f1-9780-2a30d0c7d529',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.752647] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.752831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.752890] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.753131] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.753226] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.753427] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.753549] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.753614] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.753774] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.753850] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.753932] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 already deleted. [ 1073.754023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.902774] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.902977] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.903064] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.903306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.903428] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.903608] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 316d910a-b054-4723-942e-7f84e9154008 is going to be created. [ 1073.932608] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.932791] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.932835] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.933078] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.933265] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.946263] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 316d910a-b054-4723-942e-7f84e9154008 in Status: UNINITIALIZED for 2s [ 1074.012413] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b9cb981-343d-4db5-9714-846a4e345d4b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.176974] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.177373] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.177557] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.177860] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.178014] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.178182] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 2b9f08a0-53d5-41f1-9780-2a30d0c7d529 not found, creating... [ 1074.178457] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.178622] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.178738] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.178966] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.179113] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.179484] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.179644] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.179759] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.180058] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.180329] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.180329] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 2b9f08a0-53d5-41f1-9780-2a30d0c7d529 is going to be created. [ 1074.207820] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.208218] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.208445] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.208868] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.209241] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.209606] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-2b9f08a0-53d5-41f1-9780-2a30d0c7d529" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.515491] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b9cb981-343d-4db5-9714-846a4e345d4b: rpc.has_security_group_logging(os_id): False [ 1074.536661] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.536864] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.536960] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.537249] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.537367] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.537699] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.537919] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.537919] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.538130] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.538233] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.538348] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b9cb981-343d-4db5-9714-846a4e345d4b is going to be created. [ 1074.608048] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.608285] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.608285] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.608510] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.608695] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.635799] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b9cb981-343d-4db5-9714-846a4e345d4b in Status: IN_PROGRESS for 2s [ 1074.992873] env[65783]: INFO networking_nsxv3.common.synchronization [req-63904635-3e9a-4795-a139-76e566af587d req-21adb8f5-34db-4d6e-a1a2-9f436a5e586d service nova] Enqueued Resource ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 with Priority: HIGHEST for action security_group_rules [ 1074.993112] env[65783]: INFO networking_nsxv3.common.synchronization [req-63904635-3e9a-4795-a139-76e566af587d req-21adb8f5-34db-4d6e-a1a2-9f436a5e586d service nova] Enqueued Resource ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 with Priority: HIGHEST for action security_group_members [ 1074.993288] env[65783]: INFO networking_nsxv3.common.synchronization [req-63904635-3e9a-4795-a139-76e566af587d req-21adb8f5-34db-4d6e-a1a2-9f436a5e586d service nova] Enqueued Resource ID: 2b9f08a0-53d5-41f1-9780-2a30d0c7d529 with Priority: HIGHEST for action port [ 1074.994058] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 with Priority: HIGHEST for action security_group_rules [ 1074.994247] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 with Priority: HIGHEST for action security_group_members [ 1074.994390] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b9f08a0-53d5-41f1-9780-2a30d0c7d529 with Priority: HIGHEST for action port [ 1074.994710] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-acedd9dc-9634-46d8-93d5-54ad3add17a5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.994826] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.994969] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.995247] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.995377] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.996889] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-acedd9dc-9634-46d8-93d5-54ad3add17a5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.997033] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.997109] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.997310] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.997484] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.997605] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.997652] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.997816] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.997913] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.998022] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.998959] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b9f08a0-53d5-41f1-9780-2a30d0c7d529 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.999106] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b9f08a0-53d5-41f1-9780-2a30d0c7d529" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.999206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b9f08a0-53d5-41f1-9780-2a30d0c7d529" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.999655] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b9f08a0-53d5-41f1-9780-2a30d0c7d529" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.999655] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b9f08a0-53d5-41f1-9780-2a30d0c7d529',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.502425] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.503982] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-acedd9dc-9634-46d8-93d5-54ad3add17a5 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.504191] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.504389] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b9f08a0-53d5-41f1-9780-2a30d0c7d529 with status ACTIVE [ 1075.504591] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.504716] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.504794] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.505664] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.505664] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.505664] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.505664] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.505664] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.505664] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.506083] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.506083] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.506175] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.506204] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.506329] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.506473] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.506513] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b9f08a0-53d5-41f1-9780-2a30d0c7d529 is going to be updated. [ 1075.529955] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.530332] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.530332] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.530408] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.532012] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.532012] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b9f08a0-53d5-41f1-9780-2a30d0c7d529" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.702237] env[65783]: INFO networking_nsxv3.common.synchronization [req-63904635-3e9a-4795-a139-76e566af587d req-2f3de705-b0d1-4fd8-8510-35c08d37f71b tempest-ListServersNegativeTestJSON-1635349101 tempest-ListServersNegativeTestJSON-1635349101-project-member] Enqueued Resource ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 with Priority: HIGHEST for action security_group_members [ 1075.703030] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 with Priority: HIGHEST for action security_group_members [ 1075.703678] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-acedd9dc-9634-46d8-93d5-54ad3add17a5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.703678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.961033] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 316d910a-b054-4723-942e-7f84e9154008 in Status: SUCCESS [ 1075.961297] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.961444] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.961692] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.961964] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.962154] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.962269] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.962444] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.962557] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.962657] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.962755] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.008591] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.018912] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-930 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.019129] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-930" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.019259] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-930" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.019530] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-930" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.019789] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.019946] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.020082] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.020298] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.020443] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.020657] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1076.020774] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1076.020887] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1076.021018] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1076.021126] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1076.021234] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1076.021370] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1076.049538] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1076.049780] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1076.049945] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1076.050161] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-930" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.050680] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-c26e3ef9-b46e-47db-8ad1-682fc4c31a62 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.050905] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-c26e3ef9-b46e-47db-8ad1-682fc4c31a62" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.051049] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-c26e3ef9-b46e-47db-8ad1-682fc4c31a62" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.051463] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-c26e3ef9-b46e-47db-8ad1-682fc4c31a62" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.051726] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c26e3ef9-b46e-47db-8ad1-682fc4c31a62',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.466032] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.511077] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.511077] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.511077] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.511501] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.511501] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.511501] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 is going to be created. [ 1076.540878] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.541304] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.541304] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.541497] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.541709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.554582] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.554870] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.555014] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.555327] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.555474] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.555630] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port c26e3ef9-b46e-47db-8ad1-682fc4c31a62 not found, creating... [ 1076.555934] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.556115] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.556233] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.557061] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.557061] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.557061] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.557061] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.557281] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.557353] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.557501] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.557646] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: c26e3ef9-b46e-47db-8ad1-682fc4c31a62 is going to be created. [ 1076.559941] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 in Status: UNINITIALIZED for 2s [ 1076.579896] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.580141] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.580249] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.581311] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.581311] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.581311] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-c26e3ef9-b46e-47db-8ad1-682fc4c31a62" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.666696] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b9cb981-343d-4db5-9714-846a4e345d4b in Status: SUCCESS [ 1076.666941] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.969200] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 316d910a-b054-4723-942e-7f84e9154008: rpc.has_security_group_logging(os_id): False [ 1076.994202] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.994363] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.994418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.994688] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.994788] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.995052] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.995162] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.995227] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.995388] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.995465] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.995553] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 316d910a-b054-4723-942e-7f84e9154008 is going to be created. [ 1077.064672] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.064896] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.064972] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.065213] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.065402] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.078912] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 316d910a-b054-4723-942e-7f84e9154008 in Status: IN_PROGRESS for 2s [ 1077.339048] env[65783]: INFO networking_nsxv3.common.synchronization [req-63904635-3e9a-4795-a139-76e566af587d req-52b645e4-c2b5-4dff-835a-1e6e291298a9 service nova] Enqueued Resource ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 with Priority: HIGHEST for action security_group_rules [ 1077.339048] env[65783]: INFO networking_nsxv3.common.synchronization [req-63904635-3e9a-4795-a139-76e566af587d req-52b645e4-c2b5-4dff-835a-1e6e291298a9 service nova] Enqueued Resource ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 with Priority: HIGHEST for action security_group_members [ 1077.339048] env[65783]: INFO networking_nsxv3.common.synchronization [req-63904635-3e9a-4795-a139-76e566af587d req-52b645e4-c2b5-4dff-835a-1e6e291298a9 service nova] Enqueued Resource ID: c26e3ef9-b46e-47db-8ad1-682fc4c31a62 with Priority: HIGHEST for action port [ 1077.339048] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 with Priority: HIGHEST for action security_group_rules [ 1077.339048] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 with Priority: HIGHEST for action security_group_members [ 1077.339048] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26e3ef9-b46e-47db-8ad1-682fc4c31a62 with Priority: HIGHEST for action port [ 1077.339048] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-acedd9dc-9634-46d8-93d5-54ad3add17a5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.339981] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.340349] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-acedd9dc-9634-46d8-93d5-54ad3add17a5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.340550] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.340832] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-c26e3ef9-b46e-47db-8ad1-682fc4c31a62 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.342024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c26e3ef9-b46e-47db-8ad1-682fc4c31a62" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.342024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c26e3ef9-b46e-47db-8ad1-682fc4c31a62" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.342024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c26e3ef9-b46e-47db-8ad1-682fc4c31a62" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.342024] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c26e3ef9-b46e-47db-8ad1-682fc4c31a62',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.627118] env[65783]: INFO networking_nsxv3.common.synchronization [req-63904635-3e9a-4795-a139-76e566af587d req-76d8ccd4-8c25-46b6-8d87-6f978a42aca5 tempest-ListServersNegativeTestJSON-1635349101 tempest-ListServersNegativeTestJSON-1635349101-project-member] Enqueued Resource ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 with Priority: HIGHEST for action security_group_members [ 1077.628784] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 with Priority: HIGHEST for action security_group_members [ 1077.628784] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-acedd9dc-9634-46d8-93d5-54ad3add17a5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.628784] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.845371] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c26e3ef9-b46e-47db-8ad1-682fc4c31a62 with status ACTIVE [ 1077.845615] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.845763] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.845856] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.846104] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.846220] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.846413] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.846515] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.846633] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.846811] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.846892] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.847337] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.847337] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.847337] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.847547] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.847547] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.847547] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c26e3ef9-b46e-47db-8ad1-682fc4c31a62 is going to be updated. [ 1077.875624] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.875961] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.876110] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.876251] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.876387] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.876554] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c26e3ef9-b46e-47db-8ad1-682fc4c31a62" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.947208] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-930 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.947411] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-930" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.947534] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-930" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.947844] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-930" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.948347] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.948586] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.948707] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.948937] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.949091] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.949328] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.949514] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1077.949644] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1077.950594] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1077.950594] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.950594] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1077.950594] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1077.978433] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1077.978576] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1077.979017] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1077.979228] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-930" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.979558] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-ef95980e-7eaa-4733-ae0d-445fe80490ea taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.979738] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-ef95980e-7eaa-4733-ae0d-445fe80490ea" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.979858] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-ef95980e-7eaa-4733-ae0d-445fe80490ea" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.980214] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-ef95980e-7eaa-4733-ae0d-445fe80490ea" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.980359] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef95980e-7eaa-4733-ae0d-445fe80490ea',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.482549] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.482958] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.483173] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.483739] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.483974] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.484220] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port ef95980e-7eaa-4733-ae0d-445fe80490ea not found, creating... [ 1078.484626] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.484872] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.485074] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.485420] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.485632] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.486127] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.486376] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.486569] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.486902] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.487137] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.487369] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: ef95980e-7eaa-4733-ae0d-445fe80490ea is going to be created. [ 1078.517710] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.518070] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.518162] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.518411] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.518638] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.518873] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-ef95980e-7eaa-4733-ae0d-445fe80490ea" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.582981] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 in Status: SUCCESS [ 1078.583245] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.583432] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.583688] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.583883] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.584012] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.584083] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.584238] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.584321] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.584407] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.584523] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.585437] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.585654] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.586155] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.586155] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.586155] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.586320] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.586320] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.586476] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.089637] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-acedd9dc-9634-46d8-93d5-54ad3add17a5 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.089637] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.089637] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.093978] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 316d910a-b054-4723-942e-7f84e9154008 in Status: SUCCESS [ 1079.093978] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.592730] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.632634] env[65783]: INFO networking_nsxv3.common.synchronization [req-de09ada5-793a-416e-b5e3-dad0a5b833d5 req-4e8dbdc4-cbdb-488f-aac4-6b261c3dc586 tempest-MultipleCreateTestJSON-1108671505 tempest-MultipleCreateTestJSON-1108671505-project-member] Enqueued Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_members [ 1079.633697] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_members [ 1079.634037] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.634208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.634301] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.634571] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.634769] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.634875] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.634974] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.635208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.635348] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.635471] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.691689] env[65783]: INFO networking_nsxv3.common.synchronization [req-63904635-3e9a-4795-a139-76e566af587d req-8af2fac4-8d3b-4285-91fd-b6b99ed5d5f8 service nova] Enqueued Resource ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 with Priority: HIGHEST for action security_group_rules [ 1079.691689] env[65783]: INFO networking_nsxv3.common.synchronization [req-63904635-3e9a-4795-a139-76e566af587d req-8af2fac4-8d3b-4285-91fd-b6b99ed5d5f8 service nova] Enqueued Resource ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 with Priority: HIGHEST for action security_group_members [ 1079.691689] env[65783]: INFO networking_nsxv3.common.synchronization [req-63904635-3e9a-4795-a139-76e566af587d req-8af2fac4-8d3b-4285-91fd-b6b99ed5d5f8 service nova] Enqueued Resource ID: ef95980e-7eaa-4733-ae0d-445fe80490ea with Priority: HIGHEST for action port [ 1079.692237] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 with Priority: HIGHEST for action security_group_rules [ 1079.692343] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 with Priority: HIGHEST for action security_group_members [ 1079.692433] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef95980e-7eaa-4733-ae0d-445fe80490ea with Priority: HIGHEST for action port [ 1079.692774] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-acedd9dc-9634-46d8-93d5-54ad3add17a5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.692837] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.692967] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-acedd9dc-9634-46d8-93d5-54ad3add17a5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.693494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.693804] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef95980e-7eaa-4733-ae0d-445fe80490ea taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.694084] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef95980e-7eaa-4733-ae0d-445fe80490ea" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.694369] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef95980e-7eaa-4733-ae0d-445fe80490ea" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.694911] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef95980e-7eaa-4733-ae0d-445fe80490ea" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.697279] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef95980e-7eaa-4733-ae0d-445fe80490ea',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.967512] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-73 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.967751] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-73" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.967907] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-73" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.968207] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-73" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.968469] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.968691] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.968804] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.969092] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.969260] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.969473] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1079.969607] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1079.969699] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1079.970189] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1079.970353] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1079.970472] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1079.970615] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1079.991776] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1079.991939] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1079.992085] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1079.992258] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-73" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.992950] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-647f361e-2e88-4fc5-a2d1-d713f32cdf72 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.992950] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-647f361e-2e88-4fc5-a2d1-d713f32cdf72" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.992950] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-647f361e-2e88-4fc5-a2d1-d713f32cdf72" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.993271] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-647f361e-2e88-4fc5-a2d1-d713f32cdf72" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.993340] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('647f361e-2e88-4fc5-a2d1-d713f32cdf72',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.096026] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.096026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.096026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.096026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.096026] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.096026] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 is going to be updated. [ 1080.126451] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.126643] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.126643] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.126909] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.127134] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.137901] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.138091] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.138160] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.138444] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.138595] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.138893] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.139071] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.139188] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.139439] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.139587] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.139739] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 is going to be deleted. [ 1080.142584] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 in Status: IN_PROGRESS for 2s [ 1080.186622] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.186622] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.186622] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.186622] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.186622] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.186622] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.203039] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ef95980e-7eaa-4733-ae0d-445fe80490ea with status ACTIVE [ 1080.203039] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.203039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.203039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.203039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.203039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.203039] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.203039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.203039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.203039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.203039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.203039] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.203039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.204188] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.204587] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.204925] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.205203] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ef95980e-7eaa-4733-ae0d-445fe80490ea is going to be updated. [ 1080.233042] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.233042] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.233042] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.233042] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.233042] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.233042] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef95980e-7eaa-4733-ae0d-445fe80490ea" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.495783] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.496090] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.496232] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.496567] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.496725] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.496889] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 647f361e-2e88-4fc5-a2d1-d713f32cdf72 not found, creating... [ 1080.497248] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.497420] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.497543] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.497783] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.497926] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.498326] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.498493] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.498637] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.498897] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.499074] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.499194] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 647f361e-2e88-4fc5-a2d1-d713f32cdf72 is going to be created. [ 1080.523683] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.523989] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.524135] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.524556] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.524819] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.525104] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-647f361e-2e88-4fc5-a2d1-d713f32cdf72" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.773166] env[65783]: INFO networking_nsxv3.common.synchronization [None req-1935544c-53eb-4d43-8cea-122e3416fb09 tempest-AttachVolumeTestJSON-999763968 tempest-AttachVolumeTestJSON-999763968-project-member] Enqueued Resource ID: 6cc4f190-878a-48bb-a700-45297dd58d68 with Priority: HIGHEST for action security_group_rules [ 1080.773307] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cc4f190-878a-48bb-a700-45297dd58d68 with Priority: HIGHEST for action security_group_rules [ 1080.773655] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6cc4f190-878a-48bb-a700-45297dd58d68 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.774351] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.774351] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.774482] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.774482] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6cc4f190-878a-48bb-a700-45297dd58d68',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.954157] env[65783]: INFO networking_nsxv3.common.synchronization [None req-30cda5cd-1e23-422f-aa2a-9c893b56cecf tempest-AttachVolumeTestJSON-999763968 tempest-AttachVolumeTestJSON-999763968-project-member] Enqueued Resource ID: 6cc4f190-878a-48bb-a700-45297dd58d68 with Priority: HIGHEST for action security_group_rules [ 1080.954825] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cc4f190-878a-48bb-a700-45297dd58d68 with Priority: HIGHEST for action security_group_rules [ 1080.955193] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6cc4f190-878a-48bb-a700-45297dd58d68 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.955317] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.264419] env[65783]: INFO networking_nsxv3.common.synchronization [req-de09ada5-793a-416e-b5e3-dad0a5b833d5 req-ee198bd7-4e61-4d74-979d-e179228b396c service nova] Enqueued Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_rules [ 1081.264698] env[65783]: INFO networking_nsxv3.common.synchronization [req-de09ada5-793a-416e-b5e3-dad0a5b833d5 req-ee198bd7-4e61-4d74-979d-e179228b396c service nova] Enqueued Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_members [ 1081.264796] env[65783]: INFO networking_nsxv3.common.synchronization [req-de09ada5-793a-416e-b5e3-dad0a5b833d5 req-ee198bd7-4e61-4d74-979d-e179228b396c service nova] Enqueued Resource ID: 647f361e-2e88-4fc5-a2d1-d713f32cdf72 with Priority: HIGHEST for action port [ 1081.265357] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_rules [ 1081.265496] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_members [ 1081.265602] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 647f361e-2e88-4fc5-a2d1-d713f32cdf72 with Priority: HIGHEST for action port [ 1081.265897] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.269363] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.269460] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.269701] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.269798] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.271168] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.271297] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.271363] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.271566] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.271751] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.271872] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.271956] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.272169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.272259] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.272357] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.273278] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-647f361e-2e88-4fc5-a2d1-d713f32cdf72 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.273398] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-647f361e-2e88-4fc5-a2d1-d713f32cdf72" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.273466] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-647f361e-2e88-4fc5-a2d1-d713f32cdf72" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.273666] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-647f361e-2e88-4fc5-a2d1-d713f32cdf72" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.273816] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('647f361e-2e88-4fc5-a2d1-d713f32cdf72',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.322411] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.322609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.322663] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.322870] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.322958] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.323072] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6cc4f190-878a-48bb-a700-45297dd58d68 already deleted. [ 1081.323162] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.323316] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.323476] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.323597] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6cc4f190-878a-48bb-a700-45297dd58d68',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.775635] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.775786] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.775967] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.776943] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 647f361e-2e88-4fc5-a2d1-d713f32cdf72 with status ACTIVE [ 1081.777059] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.777887] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.777887] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.777887] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.777887] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.778233] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.778451] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.778562] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.778766] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.778890] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.779151] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.779151] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.779302] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.779346] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.779412] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.779494] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 647f361e-2e88-4fc5-a2d1-d713f32cdf72 is going to be updated. [ 1081.802329] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.803034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.803034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.803034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.803034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.803034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-647f361e-2e88-4fc5-a2d1-d713f32cdf72" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.851281] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.851281] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.851281] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.851749] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.851749] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.851749] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6cc4f190-878a-48bb-a700-45297dd58d68 already deleted. [ 1081.851749] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.034659] env[65783]: INFO networking_nsxv3.common.synchronization [req-de09ada5-793a-416e-b5e3-dad0a5b833d5 req-b7178bd2-65d9-4b51-a59c-09b2c1fccfed tempest-MultipleCreateTestJSON-1108671505 tempest-MultipleCreateTestJSON-1108671505-project-member] Enqueued Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_members [ 1082.035558] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_members [ 1082.036761] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.036761] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.154870] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 in Status: SUCCESS [ 1082.155175] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.155421] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.156042] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.156042] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.156192] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.156192] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.156361] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.156453] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.156664] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.281822] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.456686] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-73 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.456985] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-73" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.457022] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-73" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.457288] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-73" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.458076] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.458302] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.458426] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.458677] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.458836] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.459360] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1082.459496] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1082.459615] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1082.459714] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1082.459823] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1082.459928] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1082.460319] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1082.480099] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1082.480619] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1082.480876] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1082.481160] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-73" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.481708] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-4d3fb85b-0714-4b63-ae7c-59527a920bad taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.481966] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-4d3fb85b-0714-4b63-ae7c-59527a920bad" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.482341] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-4d3fb85b-0714-4b63-ae7c-59527a920bad" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.482834] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-4d3fb85b-0714-4b63-ae7c-59527a920bad" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.483085] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d3fb85b-0714-4b63-ae7c-59527a920bad',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.658909] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.784713] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.784839] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.784839] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.785154] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.785294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.785419] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 is going to be created. [ 1082.815803] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.816027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.816136] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.816488] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.816696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.834020] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 in Status: UNINITIALIZED for 2s [ 1082.988029] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.988029] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.988029] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.988029] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.988029] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.988029] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 4d3fb85b-0714-4b63-ae7c-59527a920bad not found, creating... [ 1082.988029] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.988029] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.988379] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.988470] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.988582] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.988877] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.995848] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.995848] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.995848] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.995848] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.995848] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 4d3fb85b-0714-4b63-ae7c-59527a920bad is going to be created. [ 1083.025463] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.025463] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.025463] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.028027] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.028027] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.028027] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-4d3fb85b-0714-4b63-ae7c-59527a920bad" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.162961] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.668578] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.668578] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.668578] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.668578] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.668578] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.668578] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 is going to be updated. [ 1083.701461] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.701461] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.701788] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.702162] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.702430] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.716563] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 in Status: IN_PROGRESS for 2s [ 1083.762406] env[65783]: INFO networking_nsxv3.common.synchronization [req-de09ada5-793a-416e-b5e3-dad0a5b833d5 req-0aa2c076-e825-4ac4-a520-8bbab6ed819a service nova] Enqueued Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_rules [ 1083.762658] env[65783]: INFO networking_nsxv3.common.synchronization [req-de09ada5-793a-416e-b5e3-dad0a5b833d5 req-0aa2c076-e825-4ac4-a520-8bbab6ed819a service nova] Enqueued Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_members [ 1083.762756] env[65783]: INFO networking_nsxv3.common.synchronization [req-de09ada5-793a-416e-b5e3-dad0a5b833d5 req-0aa2c076-e825-4ac4-a520-8bbab6ed819a service nova] Enqueued Resource ID: 4d3fb85b-0714-4b63-ae7c-59527a920bad with Priority: HIGHEST for action port [ 1083.763389] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_rules [ 1083.763579] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_members [ 1083.763714] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d3fb85b-0714-4b63-ae7c-59527a920bad with Priority: HIGHEST for action port [ 1083.764245] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.764356] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.764829] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.764965] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.765293] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d3fb85b-0714-4b63-ae7c-59527a920bad taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.765429] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d3fb85b-0714-4b63-ae7c-59527a920bad" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.765528] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d3fb85b-0714-4b63-ae7c-59527a920bad" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.765878] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d3fb85b-0714-4b63-ae7c-59527a920bad" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.765963] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d3fb85b-0714-4b63-ae7c-59527a920bad',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.268392] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4d3fb85b-0714-4b63-ae7c-59527a920bad with status ACTIVE [ 1084.268750] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.268919] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.268990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.269244] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.269332] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.269528] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.269631] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.269695] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.269854] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.269948] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.270144] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.270241] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.270302] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.270470] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.270593] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.270693] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4d3fb85b-0714-4b63-ae7c-59527a920bad is going to be updated. [ 1084.301154] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.301409] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.302088] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.302417] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.302633] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.302845] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d3fb85b-0714-4b63-ae7c-59527a920bad" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.845264] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 in Status: SUCCESS [ 1084.845623] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.845700] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.845901] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.846082] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.846197] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.846257] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.846407] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.846489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.846574] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.846675] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.848446] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.848657] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.848825] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.848934] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.848999] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.849171] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.849252] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.849340] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.349835] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.350202] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.352226] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.727072] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 in Status: SUCCESS [ 1085.727325] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.727487] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.727721] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.727968] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.728200] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.728250] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.728395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.728526] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.728580] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.854857] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.232222] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.361330] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.361330] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.361330] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.361330] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.361330] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.361330] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 is going to be updated. [ 1086.393764] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.393930] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.393994] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.394228] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.394377] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.404665] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 in Status: IN_PROGRESS for 2s [ 1086.733765] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.236703] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.237126] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.237126] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.237597] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.237597] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.237597] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 is going to be updated. [ 1087.280045] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.280341] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.280341] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.280524] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.280683] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.289727] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 in Status: IN_PROGRESS for 2s [ 1088.416766] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 in Status: SUCCESS [ 1088.417222] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.417222] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.417348] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.417616] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.417976] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.417976] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.418106] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.418234] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.418361] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.765489] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1088.765669] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=8 [ 1088.922250] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.303192] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 in Status: SUCCESS [ 1089.303528] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.304225] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.304225] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.304392] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.304482] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.304563] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.305196] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.305196] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.305196] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.305611] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-acedd9dc-9634-46d8-93d5-54ad3add17a5 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.305736] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.305803] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.305934] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.306098] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.306200] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.306269] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.307059] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.307059] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.307059] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.307059] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.307625] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.307797] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.307957] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.308076] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.308212] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.308299] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.308393] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.308472] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.426486] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.812562] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for acedd9dc-9634-46d8-93d5-54ad3add17a5: rpc.has_security_group_logging(os_id): False [ 1089.812911] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.832862] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.832862] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.832862] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.834072] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.834072] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.834072] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.834072] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.834072] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.834072] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.834072] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.834340] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.834340] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.834406] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.834548] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.834782] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.834919] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.835052] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.835132] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.835283] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.835416] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.835475] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 is going to be created. [ 1089.901090] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.901242] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.901309] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.901718] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.901870] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.926509] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 in Status: IN_PROGRESS for 2s [ 1089.928760] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.928760] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.928760] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.928760] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.928760] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.928760] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 is going to be updated. [ 1089.958954] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.959150] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.959304] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.959533] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.959679] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.972645] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 in Status: IN_PROGRESS for 2s [ 1090.315303] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.818102] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.818102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.818102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.818102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.818102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.818679] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 is going to be updated. [ 1090.845449] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.845616] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.845658] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.845888] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.846050] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.854899] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 in Status: IN_PROGRESS for 2s [ 1091.942655] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 in Status: SUCCESS [ 1091.942904] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.943106] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.943317] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.943411] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.984245] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 in Status: SUCCESS [ 1091.984493] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.984680] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.984945] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.985173] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.985297] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.985361] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.985520] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.985600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.985703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.985907] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.986000] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.986068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.986232] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.986382] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.986484] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.986608] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.986687] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.986832] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.986899] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.986942] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.446318] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-acedd9dc-9634-46d8-93d5-54ad3add17a5 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.446412] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.494462] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76: rpc.has_security_group_logging(os_id): False [ 1092.515856] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.516013] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.516117] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.516277] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.517075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.517075] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.517075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.517075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.517075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.517075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.517357] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.517403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.517433] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.517601] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.517678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.517899] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.518826] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.519027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.520575] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.520575] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.520575] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 is going to be created. [ 1092.582936] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.582936] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.582936] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.583181] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.583331] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.601601] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 in Status: IN_PROGRESS for 2s [ 1092.605645] env[65783]: INFO networking_nsxv3.common.synchronization [req-a33ef799-643a-4229-8c8a-9e6d6647259b req-9279e58c-7e69-4359-8fa0-19ebfec5d953 tempest-ListServersNegativeTestJSON-1635349101 tempest-ListServersNegativeTestJSON-1635349101-project-member] Enqueued Resource ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 with Priority: HIGHEST for action security_group_members [ 1092.606361] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 with Priority: HIGHEST for action security_group_members [ 1092.606848] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-acedd9dc-9634-46d8-93d5-54ad3add17a5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.606848] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.865796] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 in Status: SUCCESS [ 1092.866052] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.866188] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.866426] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.866625] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.866747] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.866810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.866981] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.867067] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.867191] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.867297] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.868553] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.868746] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.868924] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.869049] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.869115] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.869257] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.869338] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.869428] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.371136] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-acedd9dc-9634-46d8-93d5-54ad3add17a5 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.371591] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.371591] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.866205] env[65783]: INFO networking_nsxv3.common.synchronization [req-d9b8e23e-8526-4f02-b9d8-a2c0316d2b2c req-6de20360-3753-4ac9-a6c0-7130ed306bae tempest-ServerActionsTestOtherB-29394606 tempest-ServerActionsTestOtherB-29394606-project-member] Enqueued Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_members [ 1093.866532] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_members [ 1093.866986] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c81f8cb-609b-4496-9f07-b80abbe519f8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.866986] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.867146] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.867275] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.867429] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.867524] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.867584] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.867848] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.867937] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.868044] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.874353] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.284313] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-702 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.284526] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-702" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.285054] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-702" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.285054] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-702" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.285213] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.285345] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.285462] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.285667] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.286159] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.286333] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1094.286333] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1094.286483] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1094.286527] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1094.286634] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1094.286712] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1094.286840] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1094.307258] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1094.307505] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1094.307710] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1094.307927] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-702" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.308293] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-dc5727b9-f909-4ed4-80d0-06ba5986f0cc taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.308474] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-dc5727b9-f909-4ed4-80d0-06ba5986f0cc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.308614] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-dc5727b9-f909-4ed4-80d0-06ba5986f0cc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.309351] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-dc5727b9-f909-4ed4-80d0-06ba5986f0cc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.309351] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc5727b9-f909-4ed4-80d0-06ba5986f0cc',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.370236] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.370405] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.370481] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.370698] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.370790] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.370983] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.371094] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.371153] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.371299] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.371533] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.371533] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 is going to be updated. [ 1094.379681] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.379681] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.379847] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.379917] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.380010] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.380108] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 is going to be updated. [ 1094.399504] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.399660] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.399738] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.399908] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.400077] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.414176] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: IN_PROGRESS for 2s [ 1094.420203] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.420385] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.420426] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.420609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.420744] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.432392] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 in Status: IN_PROGRESS for 2s [ 1094.616053] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 in Status: SUCCESS [ 1094.616348] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.616570] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.616844] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.616967] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.815386] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.815675] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.815848] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.816261] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.816466] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.816670] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port dc5727b9-f909-4ed4-80d0-06ba5986f0cc not found, creating... [ 1094.817024] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.817236] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.817396] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.817677] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.817864] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.818255] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.818464] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.818626] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.818898] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.819091] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.819275] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: dc5727b9-f909-4ed4-80d0-06ba5986f0cc is going to be created. [ 1094.841842] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.842191] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.842399] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.842736] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.843051] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.843356] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-dc5727b9-f909-4ed4-80d0-06ba5986f0cc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.120225] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.120434] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.120500] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.120747] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.121058] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.121216] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.121276] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.121434] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.121565] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.121665] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.121746] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.583381] env[65783]: INFO networking_nsxv3.common.synchronization [req-d9b8e23e-8526-4f02-b9d8-a2c0316d2b2c req-ecf16db0-a8a6-462c-9091-e37e3cdd0bfc service nova] Enqueued Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_rules [ 1095.583749] env[65783]: INFO networking_nsxv3.common.synchronization [req-d9b8e23e-8526-4f02-b9d8-a2c0316d2b2c req-ecf16db0-a8a6-462c-9091-e37e3cdd0bfc service nova] Enqueued Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_members [ 1095.583749] env[65783]: INFO networking_nsxv3.common.synchronization [req-d9b8e23e-8526-4f02-b9d8-a2c0316d2b2c req-ecf16db0-a8a6-462c-9091-e37e3cdd0bfc service nova] Enqueued Resource ID: dc5727b9-f909-4ed4-80d0-06ba5986f0cc with Priority: HIGHEST for action port [ 1095.584313] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_rules [ 1095.584490] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_members [ 1095.584645] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc5727b9-f909-4ed4-80d0-06ba5986f0cc with Priority: HIGHEST for action port [ 1095.585056] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c81f8cb-609b-4496-9f07-b80abbe519f8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.585209] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.585871] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.585871] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.585871] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.587127] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c81f8cb-609b-4496-9f07-b80abbe519f8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.587235] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.587453] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc5727b9-f909-4ed4-80d0-06ba5986f0cc taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.587810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc5727b9-f909-4ed4-80d0-06ba5986f0cc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.587810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc5727b9-f909-4ed4-80d0-06ba5986f0cc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.587962] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc5727b9-f909-4ed4-80d0-06ba5986f0cc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.588079] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc5727b9-f909-4ed4-80d0-06ba5986f0cc',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.624643] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.624933] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.624933] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.625134] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.625320] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.625429] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.625497] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.625668] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.625764] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.625848] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.626038] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.626147] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.626206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.626371] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.626593] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.626990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.626990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.626990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.627194] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.627194] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.627194] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.090320] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c81f8cb-609b-4496-9f07-b80abbe519f8 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.090476] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.090705] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc5727b9-f909-4ed4-80d0-06ba5986f0cc with status ACTIVE [ 1096.090889] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.091044] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.091138] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.091356] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.091475] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.091654] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.091753] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.091835] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.091986] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.092077] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.092279] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.092384] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.092448] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.092592] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.092680] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.092763] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc5727b9-f909-4ed4-80d0-06ba5986f0cc is going to be updated. [ 1096.116207] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.116403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.116448] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.116846] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.116846] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.116987] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc5727b9-f909-4ed4-80d0-06ba5986f0cc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.129511] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76: rpc.has_security_group_logging(os_id): False [ 1096.153987] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.154188] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.154188] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.154439] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.154537] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.154831] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.154938] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.155014] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.155202] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.155302] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.155487] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.155599] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.155672] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.155827] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.155924] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.156188] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.156308] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.156374] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.156544] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.156618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.156740] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 is going to be updated. [ 1096.251895] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.252194] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.252194] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.252363] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.252516] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.269566] env[65783]: INFO networking_nsxv3.common.synchronization [req-b766ddfb-6e7f-48f0-b6ee-a7303fa0fa00 req-42cc156d-1838-4adc-8f6e-a4b284cbaef3 tempest-AttachVolumeTestJSON-999763968 tempest-AttachVolumeTestJSON-999763968-project-member] Enqueued Resource ID: 6cc4f190-878a-48bb-a700-45297dd58d68 with Priority: HIGHEST for action security_group_members [ 1096.270515] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 in Status: IN_PROGRESS for 2s [ 1096.270972] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cc4f190-878a-48bb-a700-45297dd58d68 with Priority: HIGHEST for action security_group_members [ 1096.271397] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cc4f190-878a-48bb-a700-45297dd58d68 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.271463] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.271498] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.271777] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.271965] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.272058] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.272125] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.272283] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.272370] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.272467] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cc4f190-878a-48bb-a700-45297dd58d68',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.427711] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: SUCCESS [ 1096.428186] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 deletion is rescheduled due to dependency. [ 1096.428186] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.428186] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.428389] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.428574] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.428691] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.428754] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.428903] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.428985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.429091] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.446031] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 in Status: SUCCESS [ 1096.446031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.446031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.446264] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.446326] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.446423] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.446491] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.446632] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.446734] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.446799] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.446941] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-acedd9dc-9634-46d8-93d5-54ad3add17a5 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.447049] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.447111] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.447227] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.447359] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.447443] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.447492] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.448247] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.448247] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.448247] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.448247] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.692676] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-402 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.692676] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-402" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.692676] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-402" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.692676] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-402" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.692676] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.692676] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.693547] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.693547] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.693547] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.693547] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1096.694142] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1096.694142] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1096.694142] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1096.694142] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1096.694142] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1096.694142] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1096.714856] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1096.715088] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1096.715233] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1096.715423] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-402" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.716339] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-3ace6194-8918-410f-a12e-0f966ea6e08e taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.716339] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-3ace6194-8918-410f-a12e-0f966ea6e08e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.716339] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-3ace6194-8918-410f-a12e-0f966ea6e08e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.716596] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-3ace6194-8918-410f-a12e-0f966ea6e08e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.716650] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ace6194-8918-410f-a12e-0f966ea6e08e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.756041] env[65783]: INFO networking_nsxv3.common.synchronization [req-31d76123-fd70-4b6d-a7ca-3329d3a070d4 req-bd727f9a-11e1-40a3-a8b7-dce25cbda357 tempest-MultipleCreateTestJSON-1108671505 tempest-MultipleCreateTestJSON-1108671505-project-member] Enqueued Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_members [ 1096.756041] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_members [ 1096.756376] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.756502] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.756569] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.756764] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.756915] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.757251] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.757344] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.757507] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.757633] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.757748] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.774916] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.775125] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.775187] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.775364] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.775451] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.775633] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.775729] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.775793] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.775980] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.776088] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.776173] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cc4f190-878a-48bb-a700-45297dd58d68 already deleted. [ 1096.776252] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.931508] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.949414] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for acedd9dc-9634-46d8-93d5-54ad3add17a5: rpc.has_security_group_logging(os_id): False [ 1096.969576] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.969782] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.969782] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.969998] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.970110] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.970305] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.970407] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.970717] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.970717] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.970717] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.970873] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.970967] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.971039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.971188] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.971264] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.971444] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.971541] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.971614] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.971914] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.972017] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.972104] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 is going to be updated. [ 1097.039133] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.039345] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.039345] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.039619] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.040103] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.055732] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 in Status: IN_PROGRESS for 2s [ 1097.092975] env[65783]: INFO networking_nsxv3.common.synchronization [req-00dede9a-4834-4a0b-9086-1e6cd28d0e8e req-f6c3f9dc-8034-4259-936f-584119e062c7 tempest-MultipleCreateTestJSON-1108671505 tempest-MultipleCreateTestJSON-1108671505-project-member] Enqueued Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_members [ 1097.093578] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGHEST for action security_group_members [ 1097.093970] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.094086] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.220028] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.220028] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.220028] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.221340] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.221340] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.221340] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 3ace6194-8918-410f-a12e-0f966ea6e08e not found, creating... [ 1097.221340] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.221340] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.221340] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.221848] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.222084] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.222436] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.222723] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.223130] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.223529] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.224023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.224023] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 3ace6194-8918-410f-a12e-0f966ea6e08e is going to be created. [ 1097.248059] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.248304] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.249247] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.249247] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.249247] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.249247] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-3ace6194-8918-410f-a12e-0f966ea6e08e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.260279] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.433867] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.762158] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.936666] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.936666] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.936666] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.936666] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.936666] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.936666] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 is going to be updated. [ 1097.953260] env[65783]: INFO networking_nsxv3.common.synchronization [req-b766ddfb-6e7f-48f0-b6ee-a7303fa0fa00 req-e6568b87-c2e0-4fa0-978f-ffb33de391b7 service nova] Enqueued Resource ID: 6cc4f190-878a-48bb-a700-45297dd58d68 with Priority: HIGHEST for action security_group_rules [ 1097.953437] env[65783]: INFO networking_nsxv3.common.synchronization [req-b766ddfb-6e7f-48f0-b6ee-a7303fa0fa00 req-e6568b87-c2e0-4fa0-978f-ffb33de391b7 service nova] Enqueued Resource ID: 6cc4f190-878a-48bb-a700-45297dd58d68 with Priority: HIGHEST for action security_group_members [ 1097.953572] env[65783]: INFO networking_nsxv3.common.synchronization [req-b766ddfb-6e7f-48f0-b6ee-a7303fa0fa00 req-e6568b87-c2e0-4fa0-978f-ffb33de391b7 service nova] Enqueued Resource ID: 3ace6194-8918-410f-a12e-0f966ea6e08e with Priority: HIGHEST for action port [ 1097.954239] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cc4f190-878a-48bb-a700-45297dd58d68 with Priority: HIGHEST for action security_group_rules [ 1097.954506] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cc4f190-878a-48bb-a700-45297dd58d68 with Priority: HIGHEST for action security_group_members [ 1097.954628] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ace6194-8918-410f-a12e-0f966ea6e08e with Priority: HIGHEST for action port [ 1097.954952] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6cc4f190-878a-48bb-a700-45297dd58d68 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.955110] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.955176] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.955432] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.955549] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6cc4f190-878a-48bb-a700-45297dd58d68',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.956515] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cc4f190-878a-48bb-a700-45297dd58d68 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.956625] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.956692] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.956862] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.957013] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.957110] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.957202] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.957305] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.957385] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.957476] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cc4f190-878a-48bb-a700-45297dd58d68',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.958193] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ace6194-8918-410f-a12e-0f966ea6e08e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.958296] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ace6194-8918-410f-a12e-0f966ea6e08e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.958356] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ace6194-8918-410f-a12e-0f966ea6e08e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.958726] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ace6194-8918-410f-a12e-0f966ea6e08e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.958726] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ace6194-8918-410f-a12e-0f966ea6e08e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.966853] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.966949] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.967041] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.967240] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.967380] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.978686] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: IN_PROGRESS for 2s [ 1098.265691] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.265880] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.265880] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.266159] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.266257] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.266363] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 is going to be updated. [ 1098.291285] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 in Status: SUCCESS [ 1098.291646] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.304034] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.304154] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.304154] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.304362] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.304629] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.314363] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 in Status: IN_PROGRESS for 2s [ 1098.461092] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cc4f190-878a-48bb-a700-45297dd58d68 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.461218] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.461561] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6cc4f190-878a-48bb-a700-45297dd58d68',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.462708] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ace6194-8918-410f-a12e-0f966ea6e08e with status ACTIVE [ 1098.463452] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.463452] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.463452] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.466013] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.466013] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.466013] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.466013] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.466013] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.466013] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.466013] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.466013] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.466013] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.466013] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.466766] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.466912] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.467113] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ace6194-8918-410f-a12e-0f966ea6e08e is going to be updated. [ 1098.493788] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.493788] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.493788] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.493788] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.493788] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.493788] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ace6194-8918-410f-a12e-0f966ea6e08e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.654905] env[65783]: INFO networking_nsxv3.common.synchronization [req-cbb015a7-f1f5-4d76-8200-bf75668ae666 req-efff028b-8f75-4b1a-8a38-af82d651f676 tempest-DeleteServersTestJSON-1456685968 tempest-DeleteServersTestJSON-1456685968-project-member] Enqueued Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 1098.660563] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 1098.661787] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.662036] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.662155] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.662458] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.662705] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.662857] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.662954] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.663205] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.663338] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.663604] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.969240] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6cc4f190-878a-48bb-a700-45297dd58d68',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.974648] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-131 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.974892] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-131" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.975050] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-131" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.975336] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-131" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.975598] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.975775] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.975877] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.976111] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.976253] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.976465] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1098.976770] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1098.976770] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1098.976770] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1098.977101] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1098.977101] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1098.977186] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1099.000202] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1099.000202] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1099.000202] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1099.000202] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-131" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.000202] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-01a9f4ea-b2f3-4855-a441-4a5a0972a960 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.000202] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-01a9f4ea-b2f3-4855-a441-4a5a0972a960" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.000471] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-01a9f4ea-b2f3-4855-a441-4a5a0972a960" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.000901] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-01a9f4ea-b2f3-4855-a441-4a5a0972a960" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.001200] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01a9f4ea-b2f3-4855-a441-4a5a0972a960',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.073888] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 in Status: SUCCESS [ 1099.073888] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.073888] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.073888] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.074291] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.169539] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.169711] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.170169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.170169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.170169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.170431] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.170542] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.170618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.170784] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.170901] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.171014] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 is going to be updated. [ 1099.200485] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.200831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.201015] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.201248] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.201465] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.212931] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: IN_PROGRESS for 2s [ 1099.471187] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.471336] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.471386] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.471606] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.471705] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.471804] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cc4f190-878a-48bb-a700-45297dd58d68 is going to be created. [ 1099.494332] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.494558] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.494558] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.494726] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.494904] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.505062] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.505062] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.505062] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.505062] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.505062] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.505601] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 01a9f4ea-b2f3-4855-a441-4a5a0972a960 not found, creating... [ 1099.505601] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.505601] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.505601] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.505835] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.506044] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.506259] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.506416] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.506531] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.506769] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.506879] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.507027] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 01a9f4ea-b2f3-4855-a441-4a5a0972a960 is going to be created. [ 1099.508568] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cc4f190-878a-48bb-a700-45297dd58d68 in Status: UNINITIALIZED for 2s [ 1099.527286] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.527479] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.527648] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.527875] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.528113] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.528333] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-01a9f4ea-b2f3-4855-a441-4a5a0972a960" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.577194] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-acedd9dc-9634-46d8-93d5-54ad3add17a5 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.577422] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.577422] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.577694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.577858] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.578125] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.578208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.578389] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.578483] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.578577] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.578672] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.989671] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: SUCCESS [ 1099.990030] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.990294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.990599] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.990899] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.991091] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.991198] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.991446] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.991574] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.991722] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.991861] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.081483] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-acedd9dc-9634-46d8-93d5-54ad3add17a5 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.081710] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.081807] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.082056] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.082239] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.082345] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.082408] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.082559] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.082648] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.082760] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.082912] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-acedd9dc-9634-46d8-93d5-54ad3add17a5 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.083010] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.083079] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.083225] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.083369] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.083455] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.083518] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.083701] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.083796] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.083896] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.083984] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.251161] env[65783]: INFO networking_nsxv3.common.synchronization [req-cbb015a7-f1f5-4d76-8200-bf75668ae666 req-dca8d4f6-2bee-497f-83d7-cbccd5b845e0 service nova] Enqueued Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_rules [ 1100.251398] env[65783]: INFO networking_nsxv3.common.synchronization [req-cbb015a7-f1f5-4d76-8200-bf75668ae666 req-dca8d4f6-2bee-497f-83d7-cbccd5b845e0 service nova] Enqueued Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 1100.251494] env[65783]: INFO networking_nsxv3.common.synchronization [req-cbb015a7-f1f5-4d76-8200-bf75668ae666 req-dca8d4f6-2bee-497f-83d7-cbccd5b845e0 service nova] Enqueued Resource ID: 01a9f4ea-b2f3-4855-a441-4a5a0972a960 with Priority: HIGHEST for action port [ 1100.252443] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_rules [ 1100.252613] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 1100.252730] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a9f4ea-b2f3-4855-a441-4a5a0972a960 with Priority: HIGHEST for action port [ 1100.253106] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.253179] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.253266] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.253434] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.253519] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.255755] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.255755] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.255755] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-01a9f4ea-b2f3-4855-a441-4a5a0972a960 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.255919] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01a9f4ea-b2f3-4855-a441-4a5a0972a960" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.256020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01a9f4ea-b2f3-4855-a441-4a5a0972a960" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.256236] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01a9f4ea-b2f3-4855-a441-4a5a0972a960" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.256388] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01a9f4ea-b2f3-4855-a441-4a5a0972a960',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.325017] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 in Status: SUCCESS [ 1100.325336] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.325587] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.325845] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.326060] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.326220] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.326322] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.326554] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.326654] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.326763] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.494495] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.586901] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for acedd9dc-9634-46d8-93d5-54ad3add17a5: rpc.has_security_group_logging(os_id): False [ 1100.604087] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.604256] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.604301] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.604511] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.604601] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.604829] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.604963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.604963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.605141] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.605218] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.605419] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.605514] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.605577] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.605718] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.605795] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.605971] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.606078] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.606141] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.606279] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.606354] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.606438] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 is going to be updated. [ 1100.664914] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.665099] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.665155] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.665351] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.665499] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.681385] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 in Status: IN_PROGRESS for 2s [ 1100.756651] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.756824] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.759234] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01a9f4ea-b2f3-4855-a441-4a5a0972a960 with status ACTIVE [ 1100.759661] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.759661] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.759786] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.759998] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.760116] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.760275] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.760368] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.760430] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.760598] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.760680] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.760901] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.760984] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.761027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.761154] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.761317] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.761410] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01a9f4ea-b2f3-4855-a441-4a5a0972a960 is going to be updated. [ 1100.790552] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.790665] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.790717] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.791059] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.791278] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.791483] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01a9f4ea-b2f3-4855-a441-4a5a0972a960" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.829245] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.829450] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.829486] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.829679] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.829770] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.829972] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.830081] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.830140] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.830325] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.830359] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.830440] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 is going to be updated. [ 1100.858952] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.859158] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.859214] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.859410] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.859509] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.869037] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 in Status: IN_PROGRESS for 2s [ 1100.997091] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c81f8cb-609b-4496-9f07-b80abbe519f8: rpc.has_security_group_logging(os_id): False [ 1101.018239] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.018427] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.018471] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.018666] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.018764] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.019065] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.019136] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.019192] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.019342] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.019418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.019503] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 is going to be updated. [ 1101.084515] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.084719] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.084771] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.084958] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.085114] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.108025] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: IN_PROGRESS for 2s [ 1101.223498] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: SUCCESS [ 1101.223726] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 deletion is rescheduled due to dependency. [ 1101.223851] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.224014] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.224233] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.224419] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.224536] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.224598] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.225072] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.225072] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.225072] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.519061] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cc4f190-878a-48bb-a700-45297dd58d68 in Status: SUCCESS [ 1101.519356] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.519446] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.519666] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.519881] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.519966] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.520044] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.520198] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.520280] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.520367] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.520546] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6cc4f190-878a-48bb-a700-45297dd58d68',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.727081] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.022397] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6cc4f190-878a-48bb-a700-45297dd58d68',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.229647] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.525435] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6cc4f190-878a-48bb-a700-45297dd58d68: rpc.has_security_group_logging(os_id): False [ 1102.548641] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.548870] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.549020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.549930] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.549930] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.549930] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.550336] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.550458] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.551061] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.551061] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.551061] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6cc4f190-878a-48bb-a700-45297dd58d68 is going to be created. [ 1102.631160] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.631160] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.631160] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.631160] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.631160] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.644180] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6cc4f190-878a-48bb-a700-45297dd58d68 in Status: IN_PROGRESS for 2s [ 1102.708665] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 in Status: SUCCESS [ 1102.708926] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.731731] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.732021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.732099] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.732375] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.732473] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.732576] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 is going to be updated. [ 1102.766790] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.767022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.767022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.767171] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.767298] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.780033] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: IN_PROGRESS for 2s [ 1102.879924] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 in Status: SUCCESS [ 1102.880129] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 deletion is rescheduled due to dependency. [ 1102.880250] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.124617] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: SUCCESS [ 1103.125033] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.816434] env[65783]: INFO networking_nsxv3.common.synchronization [req-e05bd3db-d1e9-4156-b0db-e3e716d7ecb1 req-602c9103-3f8f-4b35-a7fd-609350997f3c tempest-ListServersNegativeTestJSON-1635349101 tempest-ListServersNegativeTestJSON-1635349101-project-member] Enqueued Resource ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 with Priority: HIGHEST for action security_group_members [ 1103.816977] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 with Priority: HIGHEST for action security_group_members [ 1103.821118] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-acedd9dc-9634-46d8-93d5-54ad3add17a5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.821118] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.821118] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.821118] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.821118] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.821118] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.821118] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.821118] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.821118] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.821118] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.829455] env[65783]: INFO networking_nsxv3.common.synchronization [req-d969429a-d0a0-49a8-b8ff-4357f78577eb req-111a3b05-1d71-41a3-b889-d399cee60e68 tempest-ListServersNegativeTestJSON-1635349101 tempest-ListServersNegativeTestJSON-1635349101-project-member] Enqueued Resource ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 with Priority: HIGHEST for action security_group_members [ 1103.830040] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 with Priority: HIGHEST for action security_group_members [ 1103.830333] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-acedd9dc-9634-46d8-93d5-54ad3add17a5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.830447] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.322874] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.323275] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.323275] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.323364] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.323477] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.323626] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.323797] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.323866] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.324050] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.324166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.324304] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 is going to be updated. [ 1104.356407] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.356561] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.356631] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.356851] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.357081] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.366476] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 in Status: IN_PROGRESS for 2s [ 1104.659834] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6cc4f190-878a-48bb-a700-45297dd58d68 in Status: SUCCESS [ 1104.659834] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.793876] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: SUCCESS [ 1104.794122] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.794354] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.794599] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.794914] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.795070] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.795135] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.795306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.795393] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.795484] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.795579] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.299013] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.299013] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.299013] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.299380] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.299496] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.299605] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.299691] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.299838] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.300040] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.300267] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.300388] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.300473] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.300548] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.300703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.300848] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.300984] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.301053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.301165] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.301384] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.301496] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.301658] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.804207] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a56944ee-f571-421e-aac3-fe1ac51a1fd9: rpc.has_security_group_logging(os_id): False [ 1105.826325] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.826325] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.826325] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.826856] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.826986] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.827360] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.827634] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.827634] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.827837] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.827926] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.828204] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.828345] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.828396] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.834861] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.834861] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.834861] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.834861] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.834861] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.834861] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.834861] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.834861] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 is going to be updated. [ 1105.903954] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.904057] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.904657] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.904657] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.904657] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.923221] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: IN_PROGRESS for 2s [ 1106.375591] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 in Status: SUCCESS [ 1106.375737] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 deletion is rescheduled due to dependency. [ 1106.375839] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.376057] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.376278] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.376462] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.376575] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.376639] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.376785] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.376870] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.376963] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.879503] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.879503] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.879503] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.879940] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.879940] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.879940] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.879940] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.880179] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.880179] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.880266] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.880312] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 is going to be updated. [ 1106.909607] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.909792] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.909792] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.910081] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.910231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.921516] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 in Status: IN_PROGRESS for 2s [ 1107.424097] env[65783]: INFO networking_nsxv3.common.synchronization [req-9af37f8d-d49d-4bd6-84b4-d7dd64240ef2 req-ed0e307f-2332-43ac-bd94-f93780f07a00 tempest-AttachVolumeNegativeTest-1814624860 tempest-AttachVolumeNegativeTest-1814624860-project-member] Enqueued Resource ID: 99e0c417-31bf-428f-9d83-2ec769f78d5e with Priority: HIGHEST for action security_group_members [ 1107.424673] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99e0c417-31bf-428f-9d83-2ec769f78d5e with Priority: HIGHEST for action security_group_members [ 1107.425102] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-99e0c417-31bf-428f-9d83-2ec769f78d5e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.425230] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.425288] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.425492] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.425643] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.425941] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.426053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.426350] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.426350] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.426450] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99e0c417-31bf-428f-9d83-2ec769f78d5e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.929898] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.930184] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.930184] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.930356] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.930487] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.930638] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.930738] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.930801] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.930948] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.931030] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.931121] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99e0c417-31bf-428f-9d83-2ec769f78d5e is going to be updated. [ 1107.946307] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: SUCCESS [ 1107.946474] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.966985] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.966985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.966985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.967188] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.969357] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.979655] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99e0c417-31bf-428f-9d83-2ec769f78d5e in Status: IN_PROGRESS for 2s [ 1108.547273] env[65783]: INFO networking_nsxv3.common.synchronization [None req-c84dcd96-b989-4fc1-97ad-c2ea0f48b362 None None] Enqueued Resource ID: 0e95505a-c7dd-4182-872f-10a99cbc69b7 with Priority: HIGHEST for action port [ 1108.547707] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e95505a-c7dd-4182-872f-10a99cbc69b7 with Priority: HIGHEST for action port [ 1108.548307] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e95505a-c7dd-4182-872f-10a99cbc69b7 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.548408] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e95505a-c7dd-4182-872f-10a99cbc69b7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.548470] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e95505a-c7dd-4182-872f-10a99cbc69b7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.548929] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e95505a-c7dd-4182-872f-10a99cbc69b7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.552033] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e95505a-c7dd-4182-872f-10a99cbc69b7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.933408] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 in Status: SUCCESS [ 1108.933705] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 deletion is rescheduled due to dependency. [ 1108.933795] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.053620] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e95505a-c7dd-4182-872f-10a99cbc69b7 [ 1109.053939] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.054084] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.054159] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.054424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.054509] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.054611] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e95505a-c7dd-4182-872f-10a99cbc69b7 already deleted. [ 1109.054689] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e95505a-c7dd-4182-872f-10a99cbc69b7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.991051] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99e0c417-31bf-428f-9d83-2ec769f78d5e in Status: SUCCESS [ 1109.991051] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99e0c417-31bf-428f-9d83-2ec769f78d5e deletion is rescheduled due to dependency. [ 1109.991051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.124583] env[65783]: INFO networking_nsxv3.common.synchronization [None req-90e16fbd-e91b-4fa8-ac6c-32f5711174ad None None] Enqueued Resource ID: ce81bc3d-47b4-4069-9a03-c38efaa2910b with Priority: HIGHEST for action port [ 1111.125227] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce81bc3d-47b4-4069-9a03-c38efaa2910b with Priority: HIGHEST for action port [ 1111.125597] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce81bc3d-47b4-4069-9a03-c38efaa2910b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.125732] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce81bc3d-47b4-4069-9a03-c38efaa2910b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.125891] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce81bc3d-47b4-4069-9a03-c38efaa2910b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.126071] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce81bc3d-47b4-4069-9a03-c38efaa2910b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.126155] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce81bc3d-47b4-4069-9a03-c38efaa2910b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.628735] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ce81bc3d-47b4-4069-9a03-c38efaa2910b [ 1111.630125] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.630422] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.630672] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.630950] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.631100] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.631380] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ce81bc3d-47b4-4069-9a03-c38efaa2910b already deleted. [ 1111.632419] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce81bc3d-47b4-4069-9a03-c38efaa2910b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.572963] env[65783]: INFO networking_nsxv3.common.synchronization [None req-9d1d4fa1-6d8f-4774-8eb1-18a78f42ace3 None None] Enqueued Resource ID: a9cfa36f-ed7d-4482-8975-a17c876f07fe with Priority: HIGHEST for action port [ 1113.573705] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9cfa36f-ed7d-4482-8975-a17c876f07fe with Priority: HIGHEST for action port [ 1113.573975] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9cfa36f-ed7d-4482-8975-a17c876f07fe taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.573975] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9cfa36f-ed7d-4482-8975-a17c876f07fe" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.574074] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9cfa36f-ed7d-4482-8975-a17c876f07fe" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.574576] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9cfa36f-ed7d-4482-8975-a17c876f07fe" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.574709] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9cfa36f-ed7d-4482-8975-a17c876f07fe',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.989512] env[65783]: INFO networking_nsxv3.common.synchronization [req-3061856c-fb49-4a51-918a-41a289c35208 req-79566487-c056-41ad-8dcb-c1a2a498ad71 tempest-DeleteServersTestJSON-1456685968 tempest-DeleteServersTestJSON-1456685968-project-member] Enqueued Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 1113.991995] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 1113.991995] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.991995] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.991995] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.991995] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.991995] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.991995] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.991995] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.991995] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.991995] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.991995] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.076743] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9cfa36f-ed7d-4482-8975-a17c876f07fe [ 1114.077744] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.077744] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.077744] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.077744] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.077744] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.077976] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9cfa36f-ed7d-4482-8975-a17c876f07fe already deleted. [ 1114.077976] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9cfa36f-ed7d-4482-8975-a17c876f07fe" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.494788] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.494953] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.495059] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.495294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.495389] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.495589] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.495690] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.495754] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.495910] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.496524] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.496524] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 is going to be updated. [ 1114.538228] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.538397] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.538469] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.538647] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.540505] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.551274] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: IN_PROGRESS for 2s [ 1116.150975] env[65783]: INFO networking_nsxv3.common.synchronization [None req-e44c3609-7d0a-46d7-aa22-bc0400e96e67 None None] Enqueued Resource ID: 448aa044-ebb0-474d-a0ae-62b683c47200 with Priority: HIGHEST for action port [ 1116.152243] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 448aa044-ebb0-474d-a0ae-62b683c47200 with Priority: HIGHEST for action port [ 1116.152694] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-448aa044-ebb0-474d-a0ae-62b683c47200 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.152851] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-448aa044-ebb0-474d-a0ae-62b683c47200" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.152927] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-448aa044-ebb0-474d-a0ae-62b683c47200" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.153206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-448aa044-ebb0-474d-a0ae-62b683c47200" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.153376] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('448aa044-ebb0-474d-a0ae-62b683c47200',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.346274] env[65783]: INFO networking_nsxv3.common.synchronization [req-f99ee299-8189-4d7c-ac9b-35cdb6186f10 req-6177e29e-2ed9-41d0-b648-ac22e774b6e8 tempest-ServersTestJSON-581224055 tempest-ServersTestJSON-581224055-project-member] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1116.346633] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1116.346914] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.347049] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.347131] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.347479] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.347635] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.347733] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.347796] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.347950] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.348049] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.348158] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.562233] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: SUCCESS [ 1116.562393] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 deletion is rescheduled due to dependency. [ 1116.562488] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.656561] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 448aa044-ebb0-474d-a0ae-62b683c47200 [ 1116.656805] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.656986] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.657079] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.657372] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.657372] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.657473] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:448aa044-ebb0-474d-a0ae-62b683c47200 already deleted. [ 1116.657559] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-448aa044-ebb0-474d-a0ae-62b683c47200" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.684591] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-334 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.684785] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-334" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.684910] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-334" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.685319] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-334" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.685595] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.686074] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.686074] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.686215] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.686254] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.686473] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1116.686585] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1116.686693] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1116.686803] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1116.686910] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1116.687023] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1116.687157] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1116.707026] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1116.707186] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1116.707186] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1116.707357] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-334" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.708271] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-c2856b60-c6f3-40b5-a301-a764e0b447eb taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.708271] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-c2856b60-c6f3-40b5-a301-a764e0b447eb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.708271] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-c2856b60-c6f3-40b5-a301-a764e0b447eb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.708475] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-c2856b60-c6f3-40b5-a301-a764e0b447eb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.708524] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2856b60-c6f3-40b5-a301-a764e0b447eb',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.850892] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.851119] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.851119] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.851328] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.851415] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.851606] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.851726] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.851778] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.851928] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.852009] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.852096] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 already deleted. [ 1116.852176] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.211346] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.211718] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.211718] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.211911] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.212066] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.212224] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port c2856b60-c6f3-40b5-a301-a764e0b447eb not found, creating... [ 1117.212482] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.212636] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.212751] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.213010] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.213177] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.213460] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.213616] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.213732] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.213974] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.214285] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.214438] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: c2856b60-c6f3-40b5-a301-a764e0b447eb is going to be created. [ 1117.234235] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.234435] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.234494] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.234761] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.235046] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.235275] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-c2856b60-c6f3-40b5-a301-a764e0b447eb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.933072] env[65783]: INFO networking_nsxv3.common.synchronization [req-f99ee299-8189-4d7c-ac9b-35cdb6186f10 req-68c3bf7c-6b0a-4639-8e8b-52e20b5dbb1e service nova] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_rules [ 1117.933280] env[65783]: INFO networking_nsxv3.common.synchronization [req-f99ee299-8189-4d7c-ac9b-35cdb6186f10 req-68c3bf7c-6b0a-4639-8e8b-52e20b5dbb1e service nova] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1117.933419] env[65783]: INFO networking_nsxv3.common.synchronization [req-f99ee299-8189-4d7c-ac9b-35cdb6186f10 req-68c3bf7c-6b0a-4639-8e8b-52e20b5dbb1e service nova] Enqueued Resource ID: c2856b60-c6f3-40b5-a301-a764e0b447eb with Priority: HIGHEST for action port [ 1117.933968] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_rules [ 1117.934290] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1117.934586] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2856b60-c6f3-40b5-a301-a764e0b447eb with Priority: HIGHEST for action port [ 1117.934912] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.934912] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.934912] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.935703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.935703] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.936880] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.936880] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.936880] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.937111] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.937170] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.937268] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.937338] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.938024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.938024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.938024] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.938444] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2856b60-c6f3-40b5-a301-a764e0b447eb taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.938707] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2856b60-c6f3-40b5-a301-a764e0b447eb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.939947] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2856b60-c6f3-40b5-a301-a764e0b447eb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.940126] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2856b60-c6f3-40b5-a301-a764e0b447eb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.940228] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2856b60-c6f3-40b5-a301-a764e0b447eb',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.442632] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.442986] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.443341] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.444967] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2856b60-c6f3-40b5-a301-a764e0b447eb with status ACTIVE [ 1118.445076] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.445196] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.445301] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.445776] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.445936] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.446234] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.446403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.446509] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.446761] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.446899] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.447541] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.447541] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.447541] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.447706] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.448014] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.448014] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2856b60-c6f3-40b5-a301-a764e0b447eb is going to be updated. [ 1118.474039] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.474307] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.474307] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.474961] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.474961] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.474961] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2856b60-c6f3-40b5-a301-a764e0b447eb" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.951066] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.452658] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.452954] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.452954] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.453123] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.453214] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.453313] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 is going to be created. [ 1119.476965] env[65783]: INFO networking_nsxv3.common.synchronization [req-a179a7b5-73c7-4226-98bc-9cc95d0309ea req-3e564a57-fb71-40b0-897e-da109b48b428 tempest-AttachVolumeNegativeTest-1814624860 tempest-AttachVolumeNegativeTest-1814624860-project-member] Enqueued Resource ID: 21a0bbd4-6f51-4a42-b423-363e65f0247c with Priority: HIGHEST for action security_group_members [ 1119.478022] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21a0bbd4-6f51-4a42-b423-363e65f0247c with Priority: HIGHEST for action security_group_members [ 1119.478022] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-21a0bbd4-6f51-4a42-b423-363e65f0247c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.478022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.478022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.478256] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.478440] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.478559] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.478623] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.478784] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.478870] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.478964] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21a0bbd4-6f51-4a42-b423-363e65f0247c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.480600] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.480778] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.480832] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.480956] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.481119] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.491942] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: UNINITIALIZED for 2s [ 1119.983613] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.983846] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.983935] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.984177] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.068105] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.069072] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.069072] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.069072] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.069072] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.069072] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.069072] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21a0bbd4-6f51-4a42-b423-363e65f0247c is going to be updated. [ 1120.097069] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.097302] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.097379] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.097595] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.097779] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.107392] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21a0bbd4-6f51-4a42-b423-363e65f0247c in Status: IN_PROGRESS for 2s [ 1120.430238] env[65783]: INFO networking_nsxv3.common.synchronization [req-6a5e0813-b4af-4203-90d9-520bf0bf86d5 req-61a27d5f-3d8c-4486-8fac-68d739ad9c80 tempest-ServerRescueTestJSON-1826206369 tempest-ServerRescueTestJSON-1826206369-project-member] Enqueued Resource ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 with Priority: HIGHEST for action security_group_members [ 1120.430785] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 with Priority: HIGHEST for action security_group_members [ 1120.431312] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae30fa6b-a459-4159-9e85-a3e2921a0240 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.431312] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.431312] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.431564] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.431675] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.431787] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.431933] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.432043] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.432153] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.432227] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae30fa6b-a459-4159-9e85-a3e2921a0240',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.732706] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-612 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.733053] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-612" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.733053] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-612" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.733385] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-612" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.733644] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.733831] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.733986] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.734535] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.734748] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.735197] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1120.735396] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1120.735675] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1120.735965] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1120.736202] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1120.736367] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1120.736550] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1120.756866] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1120.757227] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1120.757227] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1120.757540] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-612" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.757661] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-dfa97bd4-874e-4c84-a6d1-d7072b745f83 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.757835] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-dfa97bd4-874e-4c84-a6d1-d7072b745f83" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.757952] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-dfa97bd4-874e-4c84-a6d1-d7072b745f83" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.758289] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-dfa97bd4-874e-4c84-a6d1-d7072b745f83" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.758426] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfa97bd4-874e-4c84-a6d1-d7072b745f83',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.933953] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.934155] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.934229] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.934473] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.934531] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.934729] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.934844] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.934919] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.935086] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.935163] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.935293] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 already deleted. [ 1120.935383] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.262876] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.263168] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.263248] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.263512] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.263656] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.263819] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port dfa97bd4-874e-4c84-a6d1-d7072b745f83 not found, creating... [ 1121.264125] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.264284] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.264399] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.264793] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.264793] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.265701] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.265701] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.265701] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.265701] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.265701] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.265972] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: dfa97bd4-874e-4c84-a6d1-d7072b745f83 is going to be created. [ 1121.288571] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.288817] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.288945] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.289253] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.289473] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.289689] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-dfa97bd4-874e-4c84-a6d1-d7072b745f83" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.503592] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: SUCCESS [ 1121.503836] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.503990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.504451] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.504950] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.504950] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.504950] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.505288] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.505288] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.505288] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.505431] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.000805] env[65783]: INFO networking_nsxv3.common.synchronization [req-6a5e0813-b4af-4203-90d9-520bf0bf86d5 req-285f6fcb-5dec-4e80-853e-57f020149536 service nova] Enqueued Resource ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 with Priority: HIGHEST for action security_group_rules [ 1122.001083] env[65783]: INFO networking_nsxv3.common.synchronization [req-6a5e0813-b4af-4203-90d9-520bf0bf86d5 req-285f6fcb-5dec-4e80-853e-57f020149536 service nova] Enqueued Resource ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 with Priority: HIGHEST for action security_group_members [ 1122.001122] env[65783]: INFO networking_nsxv3.common.synchronization [req-6a5e0813-b4af-4203-90d9-520bf0bf86d5 req-285f6fcb-5dec-4e80-853e-57f020149536 service nova] Enqueued Resource ID: dfa97bd4-874e-4c84-a6d1-d7072b745f83 with Priority: HIGHEST for action port [ 1122.001648] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 with Priority: HIGHEST for action security_group_rules [ 1122.001811] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 with Priority: HIGHEST for action security_group_members [ 1122.001969] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfa97bd4-874e-4c84-a6d1-d7072b745f83 with Priority: HIGHEST for action port [ 1122.002718] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae30fa6b-a459-4159-9e85-a3e2921a0240 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.002861] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.002950] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.003305] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.003632] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae30fa6b-a459-4159-9e85-a3e2921a0240',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.005082] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae30fa6b-a459-4159-9e85-a3e2921a0240 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.005206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.005295] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.005617] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.007051] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.007051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.007051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.007051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.007051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.007051] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae30fa6b-a459-4159-9e85-a3e2921a0240',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.007592] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfa97bd4-874e-4c84-a6d1-d7072b745f83 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.007693] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfa97bd4-874e-4c84-a6d1-d7072b745f83" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.007759] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfa97bd4-874e-4c84-a6d1-d7072b745f83" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.010965] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfa97bd4-874e-4c84-a6d1-d7072b745f83" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.010965] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfa97bd4-874e-4c84-a6d1-d7072b745f83',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.010965] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.010965] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.010965] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.010965] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.010965] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.010965] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.011441] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.011441] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.011441] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.012057] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.012412] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.013194] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.013283] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.013438] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.013831] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.013831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.013831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.014367] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.014460] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.014552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.015282] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.080789] env[65783]: INFO networking_nsxv3.common.synchronization [req-c557f15f-c524-4ced-b7f1-b5549ff98ad1 req-7e1e2834-0970-4367-b46e-a0f07661ec6e tempest-AttachInterfacesTestJSON-1497773155 tempest-AttachInterfacesTestJSON-1497773155-project-member] Enqueued Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_members [ 1122.080789] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_members [ 1122.080789] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.080789] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.080789] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.082450] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.082450] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.082450] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.082450] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.082450] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.082450] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.082450] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.119641] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21a0bbd4-6f51-4a42-b423-363e65f0247c in Status: SUCCESS [ 1122.120695] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21a0bbd4-6f51-4a42-b423-363e65f0247c deletion is rescheduled due to dependency. [ 1122.120695] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.438947] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.439164] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.439290] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.439677] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.439816] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.439973] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.440104] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.440645] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.440803] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.441017] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1122.441142] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1122.441273] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1122.441423] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1122.441568] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1122.441681] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1122.441947] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1122.461731] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1122.462377] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1122.462377] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1122.462517] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.462800] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-a99b6060-25f2-4e56-bc5b-2be77fe833dc taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.463060] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-a99b6060-25f2-4e56-bc5b-2be77fe833dc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.463219] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-a99b6060-25f2-4e56-bc5b-2be77fe833dc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.463583] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-a99b6060-25f2-4e56-bc5b-2be77fe833dc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.463765] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a99b6060-25f2-4e56-bc5b-2be77fe833dc',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.510713] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae30fa6b-a459-4159-9e85-a3e2921a0240',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.511755] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae30fa6b-a459-4159-9e85-a3e2921a0240 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.511890] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.517032] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dfa97bd4-874e-4c84-a6d1-d7072b745f83 with status ACTIVE [ 1122.517138] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.517274] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.517318] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.517499] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.517583] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.517754] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.517851] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.517921] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.518090] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.518180] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.518363] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.518455] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.518523] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.518885] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.518885] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.518885] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dfa97bd4-874e-4c84-a6d1-d7072b745f83 is going to be updated. [ 1122.519853] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b22e949b-61c8-4c23-9bc8-ab00e0ad5673: rpc.has_security_group_logging(os_id): False [ 1122.539357] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.539500] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.539500] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.539721] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.539811] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.539997] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.540108] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.540170] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.540318] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.540394] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.540592] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.540684] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.540780] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.540879] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.540950] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.541135] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.541227] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.541286] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.541451] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.541534] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.541621] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 is going to be created. [ 1122.544966] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.545092] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.545092] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.545238] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.545361] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.545514] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfa97bd4-874e-4c84-a6d1-d7072b745f83" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.585191] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.585356] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.585424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.585642] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.585736] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.585930] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.586039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.586104] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.586257] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.586334] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.586418] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce already deleted. [ 1122.586501] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.602423] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.602627] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.602627] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.602828] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.603056] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.622902] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: IN_PROGRESS for 2s [ 1122.917954] env[65783]: INFO networking_nsxv3.common.synchronization [req-ffb59086-3acd-4c36-b76c-4a20063f3161 req-0615cff0-4275-431a-a9a1-6c3b0c2ea7e9 tempest-DeleteServersTestJSON-1456685968 tempest-DeleteServersTestJSON-1456685968-project-member] Enqueued Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 1122.918521] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 1122.919124] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.919373] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.920149] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.920455] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.920676] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.920831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.920935] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.921146] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.921307] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.921448] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.966356] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.966713] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.966938] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.967286] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.967435] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.969251] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port a99b6060-25f2-4e56-bc5b-2be77fe833dc not found, creating... [ 1122.969576] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.969744] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.969863] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.970121] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.970261] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.970862] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.971043] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.971163] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.971379] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.971519] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.971653] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: a99b6060-25f2-4e56-bc5b-2be77fe833dc is going to be created. [ 1122.992345] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.993557] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.993557] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.993557] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.993557] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.993557] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-a99b6060-25f2-4e56-bc5b-2be77fe833dc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.013526] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae30fa6b-a459-4159-9e85-a3e2921a0240',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.266833] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-131 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.267081] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-131" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.267261] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-131" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.267539] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-131" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.267843] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.268027] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.268150] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.268376] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.268546] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.268789] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1123.268923] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1123.269054] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1123.269164] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1123.269703] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1123.269703] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1123.269703] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1123.288301] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1123.288510] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1123.288649] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1123.288823] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-131" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.289145] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-ec1870b5-8b77-4ad8-9779-fdcd725dd800 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.289323] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-ec1870b5-8b77-4ad8-9779-fdcd725dd800" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.289440] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-ec1870b5-8b77-4ad8-9779-fdcd725dd800" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.289775] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-ec1870b5-8b77-4ad8-9779-fdcd725dd800" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.289932] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec1870b5-8b77-4ad8-9779-fdcd725dd800',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.424597] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.424842] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.424842] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.425075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.425164] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.425407] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.425534] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.425600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.425746] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.425838] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.425928] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 is going to be updated. [ 1123.466308] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.466308] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.466308] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.466308] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.466308] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.478140] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: IN_PROGRESS for 2s [ 1123.517206] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.517430] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.517475] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.517793] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.517892] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.518064] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 is going to be created. [ 1123.556431] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.557077] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.557258] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.557544] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.557765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.573301] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 in Status: UNINITIALIZED for 2s [ 1123.699059] env[65783]: INFO networking_nsxv3.common.synchronization [req-c557f15f-c524-4ced-b7f1-b5549ff98ad1 req-f722f77b-ff54-4cfd-acf8-81250a7c91ac service nova] Enqueued Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_rules [ 1123.699318] env[65783]: INFO networking_nsxv3.common.synchronization [req-c557f15f-c524-4ced-b7f1-b5549ff98ad1 req-f722f77b-ff54-4cfd-acf8-81250a7c91ac service nova] Enqueued Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_members [ 1123.699515] env[65783]: INFO networking_nsxv3.common.synchronization [req-c557f15f-c524-4ced-b7f1-b5549ff98ad1 req-f722f77b-ff54-4cfd-acf8-81250a7c91ac service nova] Enqueued Resource ID: a99b6060-25f2-4e56-bc5b-2be77fe833dc with Priority: HIGHEST for action port [ 1123.700096] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_rules [ 1123.700266] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_members [ 1123.700505] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99b6060-25f2-4e56-bc5b-2be77fe833dc with Priority: HIGHEST for action port [ 1123.700834] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.700996] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.701081] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.701376] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.701463] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.702301] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.702418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.702484] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.703069] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.703326] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.703637] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.703637] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.703696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.705209] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.705331] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.706500] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-a99b6060-25f2-4e56-bc5b-2be77fe833dc taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.706701] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a99b6060-25f2-4e56-bc5b-2be77fe833dc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.707467] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a99b6060-25f2-4e56-bc5b-2be77fe833dc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.707467] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a99b6060-25f2-4e56-bc5b-2be77fe833dc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.707467] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a99b6060-25f2-4e56-bc5b-2be77fe833dc',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.792646] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.792986] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.793156] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.793439] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.793597] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.793776] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port ec1870b5-8b77-4ad8-9779-fdcd725dd800 not found, creating... [ 1123.794139] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.794309] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.794427] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.794655] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.794792] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.795178] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.795377] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.795532] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.795774] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.795937] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.796143] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: ec1870b5-8b77-4ad8-9779-fdcd725dd800 is going to be created. [ 1123.830090] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.830396] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.830526] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.830804] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.831153] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.831389] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-ec1870b5-8b77-4ad8-9779-fdcd725dd800" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.207146] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.208626] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a99b6060-25f2-4e56-bc5b-2be77fe833dc with status ACTIVE [ 1124.208959] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.208959] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.209073] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.209248] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.209337] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.209553] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.209639] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.209701] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.209855] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.209933] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.210173] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.210223] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.210268] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.210414] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.210494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.210576] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a99b6060-25f2-4e56-bc5b-2be77fe833dc is going to be updated. [ 1124.211845] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.211845] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.235567] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.235567] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.235799] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.235856] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.236533] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.236533] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a99b6060-25f2-4e56-bc5b-2be77fe833dc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.591404] env[65783]: INFO networking_nsxv3.common.synchronization [req-ffb59086-3acd-4c36-b76c-4a20063f3161 req-1b283c0a-670a-4b05-b205-2c6dc242fae7 service nova] Enqueued Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_rules [ 1124.591601] env[65783]: INFO networking_nsxv3.common.synchronization [req-ffb59086-3acd-4c36-b76c-4a20063f3161 req-1b283c0a-670a-4b05-b205-2c6dc242fae7 service nova] Enqueued Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 1124.591717] env[65783]: INFO networking_nsxv3.common.synchronization [req-ffb59086-3acd-4c36-b76c-4a20063f3161 req-1b283c0a-670a-4b05-b205-2c6dc242fae7 service nova] Enqueued Resource ID: ec1870b5-8b77-4ad8-9779-fdcd725dd800 with Priority: HIGHEST for action port [ 1124.592291] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_rules [ 1124.592430] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 1124.592528] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec1870b5-8b77-4ad8-9779-fdcd725dd800 with Priority: HIGHEST for action port [ 1124.596399] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.596596] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.596684] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.596934] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.597022] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.599429] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.601608] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.601608] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec1870b5-8b77-4ad8-9779-fdcd725dd800 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.601608] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec1870b5-8b77-4ad8-9779-fdcd725dd800" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.601608] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec1870b5-8b77-4ad8-9779-fdcd725dd800" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.601608] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec1870b5-8b77-4ad8-9779-fdcd725dd800" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.601608] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec1870b5-8b77-4ad8-9779-fdcd725dd800',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.636688] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: SUCCESS [ 1124.636688] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.713631] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.075874] env[65783]: INFO networking_nsxv3.common.synchronization [None req-52a8139b-54b1-4c47-8997-040c3daed0e1 tempest-AttachVolumeNegativeTest-1814624860 tempest-AttachVolumeNegativeTest-1814624860-project-member] Enqueued Resource ID: f2f8650e-b3af-426f-9fae-30baa4cb3e2c with Priority: HIGHEST for action security_group_rules [ 1125.076439] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2f8650e-b3af-426f-9fae-30baa4cb3e2c with Priority: HIGHEST for action security_group_rules [ 1125.076745] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2f8650e-b3af-426f-9fae-30baa4cb3e2c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.078477] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.078477] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.078477] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.078477] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2f8650e-b3af-426f-9fae-30baa4cb3e2c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.101781] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.101962] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.102054] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ec1870b5-8b77-4ad8-9779-fdcd725dd800 with status ACTIVE [ 1125.102225] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.103090] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.103232] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.103540] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.103642] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.103877] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.103975] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.104070] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.104283] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.104402] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.104653] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.104791] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.104874] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.105288] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.105288] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.105386] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ec1870b5-8b77-4ad8-9779-fdcd725dd800 is going to be updated. [ 1125.132285] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.132285] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.132285] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.132285] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.132285] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.132285] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec1870b5-8b77-4ad8-9779-fdcd725dd800" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.175665] env[65783]: INFO networking_nsxv3.common.synchronization [None req-dfee4dbc-d699-4880-95cf-ae1341f2fb38 tempest-AttachVolumeNegativeTest-1814624860 tempest-AttachVolumeNegativeTest-1814624860-project-member] Enqueued Resource ID: f2f8650e-b3af-426f-9fae-30baa4cb3e2c with Priority: HIGHEST for action security_group_rules [ 1125.176866] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2f8650e-b3af-426f-9fae-30baa4cb3e2c with Priority: HIGHEST for action security_group_rules [ 1125.176968] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2f8650e-b3af-426f-9fae-30baa4cb3e2c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.178889] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.215963] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.218481] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.218481] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.218481] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.218481] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.218481] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce is going to be created. [ 1125.246037] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.246229] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.246536] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.246536] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.246660] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.255415] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: UNINITIALIZED for 2s [ 1125.489306] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: SUCCESS [ 1125.489306] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 deletion is rescheduled due to dependency. [ 1125.489306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.489306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.489306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.489306] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.489306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.489306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.489306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.489306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.489306] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.585974] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 in Status: SUCCESS [ 1125.586249] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.586685] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.586685] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.586886] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.587073] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.587144] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.587696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.587696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.587696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.587902] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae30fa6b-a459-4159-9e85-a3e2921a0240',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.601351] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.601529] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.601572] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.601751] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.601898] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.602011] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2f8650e-b3af-426f-9fae-30baa4cb3e2c already deleted. [ 1125.602104] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.602676] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.602912] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.603013] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2f8650e-b3af-426f-9fae-30baa4cb3e2c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.990856] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.089885] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae30fa6b-a459-4159-9e85-a3e2921a0240 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.090114] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.090114] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.090340] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.090504] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.090604] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.090670] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.090825] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.090911] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.090998] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.091158] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae30fa6b-a459-4159-9e85-a3e2921a0240 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.091250] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.091309] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.091448] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.091585] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.091675] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.091769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.091914] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.092013] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.092112] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.092206] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae30fa6b-a459-4159-9e85-a3e2921a0240',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.126256] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.126640] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.126759] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.126959] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.127057] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.127380] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2f8650e-b3af-426f-9fae-30baa4cb3e2c already deleted. [ 1126.127502] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.493252] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.595019] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae30fa6b-a459-4159-9e85-a3e2921a0240: rpc.has_security_group_logging(os_id): False [ 1126.619402] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.619550] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.619656] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.619871] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.619972] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.620223] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.620343] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.620389] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.620555] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.620664] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.620845] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.620961] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.621061] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.621237] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.621314] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.621496] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.622727] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.622843] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.622996] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.623132] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.623232] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 is going to be created. [ 1126.710166] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.710166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.710438] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.710488] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.710649] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.725870] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 in Status: IN_PROGRESS for 2s [ 1126.996056] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.996252] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.996311] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.996537] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.996627] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.997337] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 is going to be updated. [ 1127.027792] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.027952] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.028038] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.028259] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.028403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.039262] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: IN_PROGRESS for 2s [ 1127.117194] env[65783]: INFO networking_nsxv3.common.synchronization [req-3667851f-3181-4f47-a0e0-f3629fe52b1e req-6dc40991-a56a-449e-9f68-32969351b891 tempest-AttachVolumeShelveTestJSON-903356803 tempest-AttachVolumeShelveTestJSON-903356803-project-member] Enqueued Resource ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b with Priority: HIGHEST for action security_group_members [ 1127.117652] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b with Priority: HIGHEST for action security_group_members [ 1127.117991] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.118121] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.118180] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.118483] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.118775] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.118775] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.118876] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.119516] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.119516] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.119516] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdcea21f-f135-4ab1-9f28-d5be76c7c16b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.266600] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: SUCCESS [ 1127.266600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.266600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.266600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.266600] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.266600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.266600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.266600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.266600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.266600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.266600] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.626393] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.626674] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.626674] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.626831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.626923] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.627132] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.627232] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.628020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.628020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.628020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.628020] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b is going to be updated. [ 1127.655237] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.655430] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.655476] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.655704] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.655858] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.665654] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b in Status: IN_PROGRESS for 2s [ 1127.768342] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.768507] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.768579] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.768805] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.768985] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.769113] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.769200] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.769310] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.769389] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.769474] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.769619] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.769713] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.769792] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.769940] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.770097] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.770188] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.770245] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.770379] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.770452] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.770523] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.770608] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.272732] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e3bc25c3-f702-4fff-a8a0-27dd0dc43dce: rpc.has_security_group_logging(os_id): False [ 1128.303414] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.303617] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.303737] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.304278] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.304417] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.304667] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.304778] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.304875] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.305065] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.305195] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.305478] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.305626] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.305738] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.305961] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.306092] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.306343] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.306477] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.306565] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.306759] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.306864] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.306990] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce is going to be created. [ 1128.378881] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.379038] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.379116] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.379336] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.379511] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.391204] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: IN_PROGRESS for 2s [ 1128.739020] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 in Status: SUCCESS [ 1128.739363] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.049800] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: SUCCESS [ 1129.050136] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.050327] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.050642] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.050855] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.051050] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.051121] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.051315] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.051391] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.051478] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.051570] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.554379] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.554582] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.554671] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.554956] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.555172] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.555296] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.555365] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.555555] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.555656] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.555749] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.555907] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.556008] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.556111] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.556300] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.556506] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.556634] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.556728] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.556915] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.557039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.557143] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.557268] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.678895] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b in Status: SUCCESS [ 1129.678895] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b deletion is rescheduled due to dependency. [ 1129.678895] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.059861] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a56944ee-f571-421e-aac3-fe1ac51a1fd9: rpc.has_security_group_logging(os_id): False [ 1130.078030] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.078030] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.078030] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.078264] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.078367] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.078624] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.078779] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.078819] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.078963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.079059] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.079683] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.079683] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.079683] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.079683] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.079683] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.079926] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.079926] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.079926] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.081629] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.081629] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.081629] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 is going to be updated. [ 1130.167920] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.168130] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.168178] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.168387] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.168531] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.188136] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: IN_PROGRESS for 2s [ 1130.404253] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: SUCCESS [ 1130.404417] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.978803] env[65783]: INFO networking_nsxv3.common.synchronization [req-3a446eaa-b33c-483a-80a2-b899af4e0903 req-d5609e50-8eea-4438-9b8a-8891ffe8f233 tempest-AttachVolumeNegativeTest-1814624860 tempest-AttachVolumeNegativeTest-1814624860-project-member] Enqueued Resource ID: f2f8650e-b3af-426f-9fae-30baa4cb3e2c with Priority: HIGHEST for action security_group_members [ 1131.979231] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2f8650e-b3af-426f-9fae-30baa4cb3e2c with Priority: HIGHEST for action security_group_members [ 1131.979529] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2f8650e-b3af-426f-9fae-30baa4cb3e2c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.979661] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.979715] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.979995] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.980167] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.980269] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.980362] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.980484] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.980558] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.980646] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2f8650e-b3af-426f-9fae-30baa4cb3e2c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.206688] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: SUCCESS [ 1132.206859] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.332156] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-552 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.332457] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-552" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.332665] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-552" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.332997] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-552" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.333390] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.333630] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.333781] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.334089] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.334249] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.334494] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1132.334594] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1132.334710] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1132.334819] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1132.334952] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1132.335086] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1132.335250] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1132.356176] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1132.356399] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1132.356536] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1132.356703] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-552" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.357033] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-731c93dc-1d06-4943-bac0-fc800f9f449d taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.357216] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-731c93dc-1d06-4943-bac0-fc800f9f449d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.357338] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-731c93dc-1d06-4943-bac0-fc800f9f449d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.357677] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-731c93dc-1d06-4943-bac0-fc800f9f449d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.357818] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('731c93dc-1d06-4943-bac0-fc800f9f449d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.483480] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.483635] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.483708] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.483973] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.484099] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.484298] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.484399] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.484445] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.484609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.484682] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.484777] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2f8650e-b3af-426f-9fae-30baa4cb3e2c already deleted. [ 1132.484902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.861726] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.862044] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.862152] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.862415] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.862564] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.862715] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 731c93dc-1d06-4943-bac0-fc800f9f449d not found, creating... [ 1132.862977] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.863154] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.863273] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.863488] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.863626] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.863947] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.864142] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.864262] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.864477] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.864608] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.864744] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 731c93dc-1d06-4943-bac0-fc800f9f449d is going to be created. [ 1132.886172] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.886723] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.887058] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.887366] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.887584] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.887816] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-731c93dc-1d06-4943-bac0-fc800f9f449d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.575813] env[65783]: INFO networking_nsxv3.common.synchronization [req-3a446eaa-b33c-483a-80a2-b899af4e0903 req-3df0962b-5fb9-4127-9623-0d1f6e97071e service nova] Enqueued Resource ID: f2f8650e-b3af-426f-9fae-30baa4cb3e2c with Priority: HIGHEST for action security_group_rules [ 1133.576175] env[65783]: INFO networking_nsxv3.common.synchronization [req-3a446eaa-b33c-483a-80a2-b899af4e0903 req-3df0962b-5fb9-4127-9623-0d1f6e97071e service nova] Enqueued Resource ID: f2f8650e-b3af-426f-9fae-30baa4cb3e2c with Priority: HIGHEST for action security_group_members [ 1133.576175] env[65783]: INFO networking_nsxv3.common.synchronization [req-3a446eaa-b33c-483a-80a2-b899af4e0903 req-3df0962b-5fb9-4127-9623-0d1f6e97071e service nova] Enqueued Resource ID: 731c93dc-1d06-4943-bac0-fc800f9f449d with Priority: HIGHEST for action port [ 1133.576686] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2f8650e-b3af-426f-9fae-30baa4cb3e2c with Priority: HIGHEST for action security_group_rules [ 1133.576773] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2f8650e-b3af-426f-9fae-30baa4cb3e2c with Priority: HIGHEST for action security_group_members [ 1133.576853] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 731c93dc-1d06-4943-bac0-fc800f9f449d with Priority: HIGHEST for action port [ 1133.577133] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2f8650e-b3af-426f-9fae-30baa4cb3e2c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.577257] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.577325] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.577608] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.577608] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2f8650e-b3af-426f-9fae-30baa4cb3e2c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.578503] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2f8650e-b3af-426f-9fae-30baa4cb3e2c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.578503] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.578635] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.578728] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.578871] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.579031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.579031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.579186] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.579278] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.579324] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2f8650e-b3af-426f-9fae-30baa4cb3e2c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.580601] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-731c93dc-1d06-4943-bac0-fc800f9f449d taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.580601] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-731c93dc-1d06-4943-bac0-fc800f9f449d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.580601] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-731c93dc-1d06-4943-bac0-fc800f9f449d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.581022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-731c93dc-1d06-4943-bac0-fc800f9f449d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.581022] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('731c93dc-1d06-4943-bac0-fc800f9f449d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.082455] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f2f8650e-b3af-426f-9fae-30baa4cb3e2c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.084431] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2f8650e-b3af-426f-9fae-30baa4cb3e2c taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.084575] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.084695] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 731c93dc-1d06-4943-bac0-fc800f9f449d with status ACTIVE [ 1134.084914] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.085023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.085752] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.085752] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.085752] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.085752] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.086056] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.086056] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.086056] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.086056] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.086238] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.086305] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.086408] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.086504] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.087284] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.087284] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 731c93dc-1d06-4943-bac0-fc800f9f449d is going to be updated. [ 1134.109492] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.109645] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.109690] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.109911] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.110101] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.110685] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-731c93dc-1d06-4943-bac0-fc800f9f449d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.588302] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f2f8650e-b3af-426f-9fae-30baa4cb3e2c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.663535] env[65783]: INFO networking_nsxv3.common.synchronization [None req-624d1aad-b7fe-40ad-a49c-4483b827ed92 tempest-AttachVolumeShelveTestJSON-903356803 tempest-AttachVolumeShelveTestJSON-903356803-project-member] Enqueued Resource ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 with Priority: HIGHEST for action security_group_rules [ 1134.664277] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 with Priority: HIGHEST for action security_group_rules [ 1134.664616] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb5a0c7c-b375-4d79-8e33-962a90b59498 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.664769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.664859] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.665195] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.665316] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb5a0c7c-b375-4d79-8e33-962a90b59498',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.746394] env[65783]: INFO networking_nsxv3.common.synchronization [None req-1904a9ae-9c0f-4e70-9a03-7286b2a4bc99 tempest-AttachVolumeShelveTestJSON-903356803 tempest-AttachVolumeShelveTestJSON-903356803-project-member] Enqueued Resource ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 with Priority: HIGHEST for action security_group_rules [ 1134.746891] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 with Priority: HIGHEST for action security_group_rules [ 1134.747696] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb5a0c7c-b375-4d79-8e33-962a90b59498 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.747784] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.091414] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.091597] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.091650] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.092090] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.092229] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.092393] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2f8650e-b3af-426f-9fae-30baa4cb3e2c is going to be created. [ 1135.133077] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.133077] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.133077] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.133387] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.133532] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.152300] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2f8650e-b3af-426f-9fae-30baa4cb3e2c in Status: UNINITIALIZED for 2s [ 1135.191199] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.191685] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.191685] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.192099] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.192099] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.192099] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 already deleted. [ 1135.192242] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.192318] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.192489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.192602] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb5a0c7c-b375-4d79-8e33-962a90b59498',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.714115] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.714489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.714489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.714568] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.714664] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.714765] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 already deleted. [ 1135.714973] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.875839] env[65783]: INFO networking_nsxv3.common.synchronization [req-4daf61b0-5aed-4726-87bf-9dda080964e5 req-a9322090-c2c9-4096-94d5-a07083aba2cf tempest-AttachInterfacesTestJSON-1497773155 tempest-AttachInterfacesTestJSON-1497773155-project-member] Enqueued Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_members [ 1135.876393] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_members [ 1135.876751] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.876874] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.876946] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.877222] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.877414] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.877577] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.878620] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.878620] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.878620] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.878620] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.069742] env[65783]: INFO networking_nsxv3.common.synchronization [req-409e6972-7d1a-439b-bf04-caad4c9fc6ea req-91e09a13-55ea-4939-bb96-bdcd761f3b6d tempest-ServersTestJSON-581224055 tempest-ServersTestJSON-581224055-project-member] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1136.070448] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1136.070730] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.070865] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.070958] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.071265] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.071430] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.071535] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.071606] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.071780] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.071898] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.072107] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.385687] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.385864] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.386360] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.386795] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.386893] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.387502] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.387647] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.388017] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.388218] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.388301] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.388670] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce is going to be updated. [ 1136.417834] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.417953] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.418116] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.418340] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.418483] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.429369] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: IN_PROGRESS for 2s [ 1136.497032] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-334 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.497240] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-334" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.497365] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-334" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.497688] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-334" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.497993] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.498184] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.498302] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.498529] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.498666] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.498925] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1136.499094] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1136.499212] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1136.499319] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1136.499428] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1136.499530] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1136.499659] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1136.520914] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1136.521149] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1136.521354] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1136.521619] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-334" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.522042] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-502c664a-0111-47ac-9cc0-f90e3bfa3e99 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.522246] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-502c664a-0111-47ac-9cc0-f90e3bfa3e99" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.522375] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-502c664a-0111-47ac-9cc0-f90e3bfa3e99" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.522787] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-502c664a-0111-47ac-9cc0-f90e3bfa3e99" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.522952] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('502c664a-0111-47ac-9cc0-f90e3bfa3e99',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.574332] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.025969] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.026288] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.026288] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.026591] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.026745] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.026897] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 502c664a-0111-47ac-9cc0-f90e3bfa3e99 not found, creating... [ 1137.027178] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.027342] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.027458] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.027674] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.027809] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.028101] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.028257] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.028418] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.028696] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.028850] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.028995] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 502c664a-0111-47ac-9cc0-f90e3bfa3e99 is going to be created. [ 1137.050374] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.050589] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.050712] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.051014] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.051241] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.051493] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-502c664a-0111-47ac-9cc0-f90e3bfa3e99" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.077257] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.163146] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2f8650e-b3af-426f-9fae-30baa4cb3e2c in Status: SUCCESS [ 1137.163418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.163573] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.163825] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.164089] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.164225] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.164310] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.164472] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.164553] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.164696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.164755] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f2f8650e-b3af-426f-9fae-30baa4cb3e2c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.580610] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.580610] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.580610] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.580610] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.580610] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.580610] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 is going to be updated. [ 1137.624386] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.624551] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.624595] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.624809] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.624967] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.635413] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: IN_PROGRESS for 2s [ 1137.667075] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f2f8650e-b3af-426f-9fae-30baa4cb3e2c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.938867] env[65783]: INFO networking_nsxv3.common.synchronization [req-409e6972-7d1a-439b-bf04-caad4c9fc6ea req-108340cf-7d39-48d1-99a8-5867422ab541 service nova] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_rules [ 1137.939088] env[65783]: INFO networking_nsxv3.common.synchronization [req-409e6972-7d1a-439b-bf04-caad4c9fc6ea req-108340cf-7d39-48d1-99a8-5867422ab541 service nova] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1137.939234] env[65783]: INFO networking_nsxv3.common.synchronization [req-409e6972-7d1a-439b-bf04-caad4c9fc6ea req-108340cf-7d39-48d1-99a8-5867422ab541 service nova] Enqueued Resource ID: 502c664a-0111-47ac-9cc0-f90e3bfa3e99 with Priority: HIGHEST for action port [ 1137.939712] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_rules [ 1137.939845] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1137.939956] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 502c664a-0111-47ac-9cc0-f90e3bfa3e99 with Priority: HIGHEST for action port [ 1137.940252] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.940386] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.940457] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.940649] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.940729] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.941582] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.941678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.941869] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-502c664a-0111-47ac-9cc0-f90e3bfa3e99 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.941968] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-502c664a-0111-47ac-9cc0-f90e3bfa3e99" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.942123] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-502c664a-0111-47ac-9cc0-f90e3bfa3e99" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.942208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-502c664a-0111-47ac-9cc0-f90e3bfa3e99" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.942279] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('502c664a-0111-47ac-9cc0-f90e3bfa3e99',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.169449] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f2f8650e-b3af-426f-9fae-30baa4cb3e2c: rpc.has_security_group_logging(os_id): False [ 1138.189020] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.189020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.189020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.189020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.189020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.189313] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.189369] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.189403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.189550] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.189618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.189700] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2f8650e-b3af-426f-9fae-30baa4cb3e2c is going to be created. [ 1138.311397] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.311824] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.311824] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.312065] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.312272] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.340851] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2f8650e-b3af-426f-9fae-30baa4cb3e2c in Status: IN_PROGRESS for 2s [ 1138.444239] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.444318] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.444489] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 502c664a-0111-47ac-9cc0-f90e3bfa3e99 with status ACTIVE [ 1138.444672] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.444781] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.444846] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.445313] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.445415] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.445619] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.445728] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.445791] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.445971] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.446116] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.446664] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.446664] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.446664] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.446843] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.446843] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.446843] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 502c664a-0111-47ac-9cc0-f90e3bfa3e99 is going to be updated. [ 1138.456164] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: SUCCESS [ 1138.456348] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce deletion is rescheduled due to dependency. [ 1138.456464] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.472143] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.472365] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.472365] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.472633] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.472820] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.473019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-502c664a-0111-47ac-9cc0-f90e3bfa3e99" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.826996] env[65783]: INFO networking_nsxv3.common.synchronization [req-39752bda-8b3c-42d5-bf8c-781cd5038db5 req-f2d7d59c-1703-4e7f-825b-737b1dec2bf3 tempest-AttachInterfacesTestJSON-1497773155 tempest-AttachInterfacesTestJSON-1497773155-project-member] Enqueued Resource ID: 8b9cb981-343d-4db5-9714-846a4e345d4b with Priority: HIGHEST for action security_group_members [ 1138.827954] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b9cb981-343d-4db5-9714-846a4e345d4b with Priority: HIGHEST for action security_group_members [ 1138.828335] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b9cb981-343d-4db5-9714-846a4e345d4b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.828469] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.828537] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.828837] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.829058] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.829213] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.829417] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.829536] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.829646] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.829764] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b9cb981-343d-4db5-9714-846a4e345d4b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.332704] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.333781] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.333781] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.333781] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.333781] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.333781] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.334708] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.334708] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.334860] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.334860] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.334949] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b9cb981-343d-4db5-9714-846a4e345d4b is going to be updated. [ 1139.368446] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.368658] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.368658] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.368867] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.369016] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.391251] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b9cb981-343d-4db5-9714-846a4e345d4b in Status: IN_PROGRESS for 2s [ 1139.646918] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: SUCCESS [ 1139.647162] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.647334] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.647559] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.647750] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.647867] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.647931] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.648137] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.648242] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.648338] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.150627] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.357379] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2f8650e-b3af-426f-9fae-30baa4cb3e2c in Status: SUCCESS [ 1140.357801] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.653537] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.155397] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.155587] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.155768] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.155997] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.156125] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.156232] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 is going to be updated. [ 1141.185488] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.185695] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.185761] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.185996] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.186187] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.197565] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: IN_PROGRESS for 2s [ 1141.401908] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b9cb981-343d-4db5-9714-846a4e345d4b in Status: SUCCESS [ 1141.401908] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b9cb981-343d-4db5-9714-846a4e345d4b deletion is rescheduled due to dependency. [ 1141.401908] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.213087] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: SUCCESS [ 1143.213087] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.213087] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.213516] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.213516] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.213516] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.213640] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.213789] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.213914] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.214079] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.214229] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.717557] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.717719] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.717792] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.718029] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.718241] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.718300] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.718348] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.718496] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.718643] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.718697] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.718800] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.718904] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.718965] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.719130] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.719282] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.719389] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.719441] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.719920] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.719920] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.719920] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.719920] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.829480] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1143.829480] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1143.855962] env[65783]: INFO networking_nsxv3.common.synchronization [req-a0630a65-7c4c-4284-9178-53e706d353a0 req-c409ac91-5930-49cc-99d0-8bdc507f9268 tempest-AttachVolumeShelveTestJSON-903356803 tempest-AttachVolumeShelveTestJSON-903356803-project-member] Enqueued Resource ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 with Priority: HIGHEST for action security_group_members [ 1143.856430] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 with Priority: HIGHEST for action security_group_members [ 1143.856757] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb5a0c7c-b375-4d79-8e33-962a90b59498 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.856880] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.856946] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.857643] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.857772] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.857890] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.857960] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.860146] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.860146] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.860146] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb5a0c7c-b375-4d79-8e33-962a90b59498',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.203588] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-738 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.203790] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-738" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.203916] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-738" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.204279] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-738" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.204538] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.204697] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.204815] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.205048] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.205202] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.205431] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1144.205581] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1144.205697] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1144.205804] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1144.205938] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1144.206317] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1144.206317] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1144.222547] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b22e949b-61c8-4c23-9bc8-ab00e0ad5673: rpc.has_security_group_logging(os_id): False [ 1144.226837] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1144.227127] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1144.227324] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1144.227516] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-738" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.227876] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-c6074f79-c6f2-4186-b2c3-809f045737ed taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.228078] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-c6074f79-c6f2-4186-b2c3-809f045737ed" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.228205] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-c6074f79-c6f2-4186-b2c3-809f045737ed" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.228607] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-c6074f79-c6f2-4186-b2c3-809f045737ed" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.228783] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6074f79-c6f2-4186-b2c3-809f045737ed',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.248146] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.248361] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.248436] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.248614] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.248709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.249056] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.249179] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.249245] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.249450] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.249557] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.249816] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.249947] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.250020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.250210] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.250360] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.250526] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.250631] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.250703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.250863] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.250939] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.251078] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 is going to be updated. [ 1144.343953] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.343953] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.343953] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.344333] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.344368] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.361226] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: IN_PROGRESS for 2s [ 1144.361480] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.361636] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.361702] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.361945] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.362112] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.362359] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.362802] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.362802] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.362893] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.362954] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.363133] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 already deleted. [ 1144.363290] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.682844] env[65783]: INFO networking_nsxv3.common.synchronization [req-b328a9c6-5a0b-448e-b226-a27aa46f6247 req-db098c18-3d2e-4e67-814e-419882f96356 tempest-ServerActionsTestOtherA-298845163 tempest-ServerActionsTestOtherA-298845163-project-member] Enqueued Resource ID: aaf15510-666a-49d9-9a20-6f398b7f8216 with Priority: HIGHEST for action security_group_members [ 1144.683841] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaf15510-666a-49d9-9a20-6f398b7f8216 with Priority: HIGHEST for action security_group_members [ 1144.684532] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaf15510-666a-49d9-9a20-6f398b7f8216 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.684660] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.684726] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.684932] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.685672] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.685672] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.685672] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.685672] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.685672] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.685672] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aaf15510-666a-49d9-9a20-6f398b7f8216',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.731502] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.731744] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.731894] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.732328] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.732562] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.732719] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port c6074f79-c6f2-4186-b2c3-809f045737ed not found, creating... [ 1144.733030] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.733281] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.733462] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.733721] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.733947] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.734328] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.734585] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.734733] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.735042] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.735221] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.735374] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: c6074f79-c6f2-4186-b2c3-809f045737ed is going to be created. [ 1144.756160] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.756425] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.756555] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.756841] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.757110] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.757316] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-c6074f79-c6f2-4186-b2c3-809f045737ed" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.188318] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aaf15510-666a-49d9-9a20-6f398b7f8216',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.490186] env[65783]: INFO networking_nsxv3.common.synchronization [req-a0630a65-7c4c-4284-9178-53e706d353a0 req-e03c3881-9997-47b4-8463-0c43ed6cd57d service nova] Enqueued Resource ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 with Priority: HIGHEST for action security_group_rules [ 1145.490521] env[65783]: INFO networking_nsxv3.common.synchronization [req-a0630a65-7c4c-4284-9178-53e706d353a0 req-e03c3881-9997-47b4-8463-0c43ed6cd57d service nova] Enqueued Resource ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 with Priority: HIGHEST for action security_group_members [ 1145.490521] env[65783]: INFO networking_nsxv3.common.synchronization [req-a0630a65-7c4c-4284-9178-53e706d353a0 req-e03c3881-9997-47b4-8463-0c43ed6cd57d service nova] Enqueued Resource ID: c6074f79-c6f2-4186-b2c3-809f045737ed with Priority: HIGHEST for action port [ 1145.490696] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 with Priority: HIGHEST for action security_group_rules [ 1145.491397] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 with Priority: HIGHEST for action security_group_members [ 1145.491397] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6074f79-c6f2-4186-b2c3-809f045737ed with Priority: HIGHEST for action port [ 1145.491582] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb5a0c7c-b375-4d79-8e33-962a90b59498 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.491633] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.491685] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.491926] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.491926] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb5a0c7c-b375-4d79-8e33-962a90b59498',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.492754] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb5a0c7c-b375-4d79-8e33-962a90b59498 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.492868] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.492935] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.493112] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.493256] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.493349] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.493404] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.493539] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.493630] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.493716] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb5a0c7c-b375-4d79-8e33-962a90b59498',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.494671] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6074f79-c6f2-4186-b2c3-809f045737ed taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.494671] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6074f79-c6f2-4186-b2c3-809f045737ed" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.494889] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6074f79-c6f2-4186-b2c3-809f045737ed" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.495082] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6074f79-c6f2-4186-b2c3-809f045737ed" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.495141] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6074f79-c6f2-4186-b2c3-809f045737ed',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.691492] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aaf15510-666a-49d9-9a20-6f398b7f8216',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.710201] env[65783]: INFO networking_nsxv3.common.synchronization [req-fc8e3f2e-71d3-484b-b628-757912ab0cb7 req-ce7f750b-1938-47fe-bed6-8bd2122cd563 tempest-ServersTestFqdnHostnames-296510809 tempest-ServersTestFqdnHostnames-296510809-project-member] Enqueued Resource ID: af1375c2-7b1e-420c-a8d1-1ccf5e01438b with Priority: HIGHEST for action security_group_members [ 1145.710898] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1375c2-7b1e-420c-a8d1-1ccf5e01438b with Priority: HIGHEST for action security_group_members [ 1145.711267] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-af1375c2-7b1e-420c-a8d1-1ccf5e01438b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.711420] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.711464] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.711658] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.711808] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.711901] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.711960] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.712208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.712306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.712398] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af1375c2-7b1e-420c-a8d1-1ccf5e01438b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.997478] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb5a0c7c-b375-4d79-8e33-962a90b59498 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.997612] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.998283] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb5a0c7c-b375-4d79-8e33-962a90b59498',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.999567] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6074f79-c6f2-4186-b2c3-809f045737ed with status ACTIVE [ 1145.999651] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.999892] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.999892] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.000088] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.000088] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.000475] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.000475] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.000475] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.000682] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.000682] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.000845] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.000980] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.005053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.005053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.005053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.005053] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6074f79-c6f2-4186-b2c3-809f045737ed is going to be updated. [ 1146.027663] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.027848] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.027889] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.028198] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.028356] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.028544] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6074f79-c6f2-4186-b2c3-809f045737ed" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.195053] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.195239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.195239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.195463] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.195566] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.195672] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aaf15510-666a-49d9-9a20-6f398b7f8216 is going to be updated. [ 1146.215445] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.215445] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.215445] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.215663] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.215773] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.216357] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.216357] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.216357] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.216357] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.216357] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.216819] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1375c2-7b1e-420c-a8d1-1ccf5e01438b is going to be updated. [ 1146.254681] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.254855] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.254901] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.255148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.255333] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.257773] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.257886] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.257928] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.259793] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.259793] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.271034] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaf15510-666a-49d9-9a20-6f398b7f8216 in Status: IN_PROGRESS for 2s [ 1146.271730] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1375c2-7b1e-420c-a8d1-1ccf5e01438b in Status: IN_PROGRESS for 2s [ 1146.378901] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: SUCCESS [ 1146.378901] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.475746] env[65783]: INFO networking_nsxv3.common.synchronization [None req-1c8e5c34-0e8c-4375-8567-24d9c5820718 tempest-AttachInterfacesTestJSON-1497773155 tempest-AttachInterfacesTestJSON-1497773155-project-member] Enqueued Resource ID: 04bf3900-0149-4c45-92b6-cfae98a48f4e with Priority: HIGHEST for action security_group_rules [ 1146.476503] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04bf3900-0149-4c45-92b6-cfae98a48f4e with Priority: HIGHEST for action security_group_rules [ 1146.477274] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04bf3900-0149-4c45-92b6-cfae98a48f4e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.477274] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.477274] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.477274] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.477483] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04bf3900-0149-4c45-92b6-cfae98a48f4e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.505127] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb5a0c7c-b375-4d79-8e33-962a90b59498',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.582226] env[65783]: INFO networking_nsxv3.common.synchronization [None req-487c09ee-9e98-4d4e-99e2-6baae5e36b58 tempest-AttachInterfacesTestJSON-1497773155 tempest-AttachInterfacesTestJSON-1497773155-project-member] Enqueued Resource ID: 04bf3900-0149-4c45-92b6-cfae98a48f4e with Priority: HIGHEST for action security_group_rules [ 1146.582226] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04bf3900-0149-4c45-92b6-cfae98a48f4e with Priority: HIGHEST for action security_group_rules [ 1146.582226] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04bf3900-0149-4c45-92b6-cfae98a48f4e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.582226] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.999677] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.999677] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.999677] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.999908] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.000019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.000141] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04bf3900-0149-4c45-92b6-cfae98a48f4e already deleted. [ 1147.000236] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.000528] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.000733] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.000844] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04bf3900-0149-4c45-92b6-cfae98a48f4e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.009288] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.009428] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.009616] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.009746] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.009857] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.009972] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 is going to be created. [ 1147.035780] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.035938] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.036009] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.036255] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.036694] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.048353] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 in Status: UNINITIALIZED for 2s [ 1147.527162] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.527489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.527489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.527641] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.527770] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.527967] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04bf3900-0149-4c45-92b6-cfae98a48f4e already deleted. [ 1147.528122] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.101418] env[65783]: INFO networking_nsxv3.common.synchronization [req-5fc804c5-8ee0-4629-aa01-4e2261f03130 req-0d84e04b-cce3-4620-8b6c-0bb0d9fa1ce1 tempest-ServerRescueTestJSON-1826206369 tempest-ServerRescueTestJSON-1826206369-project-member] Enqueued Resource ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 with Priority: HIGHEST for action security_group_members [ 1148.101586] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 with Priority: HIGHEST for action security_group_members [ 1148.101888] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae30fa6b-a459-4159-9e85-a3e2921a0240 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.102011] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.102085] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.102283] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.102428] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.102526] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.102575] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.102714] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.102789] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.102876] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae30fa6b-a459-4159-9e85-a3e2921a0240',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.284699] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaf15510-666a-49d9-9a20-6f398b7f8216 in Status: SUCCESS [ 1148.284935] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.285781] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af1375c2-7b1e-420c-a8d1-1ccf5e01438b in Status: SUCCESS [ 1148.285936] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af1375c2-7b1e-420c-a8d1-1ccf5e01438b deletion is rescheduled due to dependency. [ 1148.286049] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.525357] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-612 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.525597] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-612" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.525704] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-612" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.526947] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-612" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.526947] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.526947] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.527229] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.527523] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.527523] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.527877] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1148.527877] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1148.527877] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1148.528015] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1148.528121] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1148.528362] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1148.528362] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1148.549968] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1148.550146] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1148.550292] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1148.550499] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-612" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.550835] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-458887b5-5ecd-41a3-9bb5-4ee7926f28ad taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.551031] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-458887b5-5ecd-41a3-9bb5-4ee7926f28ad" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.551174] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-458887b5-5ecd-41a3-9bb5-4ee7926f28ad" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.551535] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-458887b5-5ecd-41a3-9bb5-4ee7926f28ad" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.551696] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('458887b5-5ecd-41a3-9bb5-4ee7926f28ad',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.604907] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae30fa6b-a459-4159-9e85-a3e2921a0240',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.054847] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.055201] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.055410] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.055799] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.056406] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.056406] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 458887b5-5ecd-41a3-9bb5-4ee7926f28ad not found, creating... [ 1149.056726] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.057482] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.057482] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.057615] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.057858] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.058387] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.058651] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.058841] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.059187] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.059386] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.059604] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 458887b5-5ecd-41a3-9bb5-4ee7926f28ad is going to be created. [ 1149.061925] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 in Status: SUCCESS [ 1149.062317] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.062416] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.063040] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.063040] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.063228] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.063228] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.063418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.063554] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.063685] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.063823] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb5a0c7c-b375-4d79-8e33-962a90b59498',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.086362] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.086826] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.087115] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.087563] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.088164] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.088517] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-458887b5-5ecd-41a3-9bb5-4ee7926f28ad" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.109607] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae30fa6b-a459-4159-9e85-a3e2921a0240',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.567039] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb5a0c7c-b375-4d79-8e33-962a90b59498',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.612908] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.613139] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.613255] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.613561] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.613696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.613844] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 is going to be updated. [ 1149.644851] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.645116] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.645116] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.645389] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.645609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.655561] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 in Status: IN_PROGRESS for 2s [ 1149.779999] env[65783]: INFO networking_nsxv3.common.synchronization [req-5fc804c5-8ee0-4629-aa01-4e2261f03130 req-09f81e9d-adaf-4b7b-80b1-47da35bcc84b service nova] Enqueued Resource ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 with Priority: HIGHEST for action security_group_rules [ 1149.780320] env[65783]: INFO networking_nsxv3.common.synchronization [req-5fc804c5-8ee0-4629-aa01-4e2261f03130 req-09f81e9d-adaf-4b7b-80b1-47da35bcc84b service nova] Enqueued Resource ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 with Priority: HIGHEST for action security_group_members [ 1149.780498] env[65783]: INFO networking_nsxv3.common.synchronization [req-5fc804c5-8ee0-4629-aa01-4e2261f03130 req-09f81e9d-adaf-4b7b-80b1-47da35bcc84b service nova] Enqueued Resource ID: 458887b5-5ecd-41a3-9bb5-4ee7926f28ad with Priority: HIGHEST for action port [ 1149.781133] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 with Priority: HIGHEST for action security_group_rules [ 1149.781286] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 with Priority: HIGHEST for action security_group_members [ 1149.781432] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 458887b5-5ecd-41a3-9bb5-4ee7926f28ad with Priority: HIGHEST for action port [ 1149.781683] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae30fa6b-a459-4159-9e85-a3e2921a0240 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.781854] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.781996] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.782312] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.782418] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae30fa6b-a459-4159-9e85-a3e2921a0240',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.784059] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae30fa6b-a459-4159-9e85-a3e2921a0240 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.784059] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.784059] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-458887b5-5ecd-41a3-9bb5-4ee7926f28ad taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.784281] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-458887b5-5ecd-41a3-9bb5-4ee7926f28ad" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.784281] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-458887b5-5ecd-41a3-9bb5-4ee7926f28ad" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.784409] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-458887b5-5ecd-41a3-9bb5-4ee7926f28ad" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.784540] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('458887b5-5ecd-41a3-9bb5-4ee7926f28ad',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.068691] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb5a0c7c-b375-4d79-8e33-962a90b59498: rpc.has_security_group_logging(os_id): False [ 1150.090582] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.090794] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.090794] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.090985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.091093] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.091393] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.091512] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.091560] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.091686] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.091762] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.091865] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 is going to be created. [ 1150.180345] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.180563] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.180612] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.180865] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.181226] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.200560] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 in Status: IN_PROGRESS for 2s [ 1150.287141] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae30fa6b-a459-4159-9e85-a3e2921a0240 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.287300] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.288020] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 458887b5-5ecd-41a3-9bb5-4ee7926f28ad with status ACTIVE [ 1150.288020] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.288020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.288020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.288308] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.288308] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.288308] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.288416] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.288459] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.288624] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.288701] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.288890] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.288985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.289070] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.289424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.289549] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.289689] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 458887b5-5ecd-41a3-9bb5-4ee7926f28ad is going to be updated. [ 1150.329747] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.329935] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.329935] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.330058] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.330306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.330480] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-458887b5-5ecd-41a3-9bb5-4ee7926f28ad" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.375579] env[65783]: INFO networking_nsxv3.common.synchronization [req-87bccd3d-d8fa-4ce2-b33e-9c4d3d675a2f req-bce5b606-1cbc-487d-bac1-d41ea4e6661d tempest-ServersTestJSON-581224055 tempest-ServersTestJSON-581224055-project-member] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1151.376791] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1151.376791] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.376791] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.376791] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.377070] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.377205] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.377352] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.377433] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.377586] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.377692] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.377794] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.669350] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 in Status: SUCCESS [ 1151.669350] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.669350] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.669350] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.669350] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.669350] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.669350] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.669350] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.669350] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.669350] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae30fa6b-a459-4159-9e85-a3e2921a0240',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.883640] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.171410] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae30fa6b-a459-4159-9e85-a3e2921a0240',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.215689] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 in Status: SUCCESS [ 1152.215913] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.385255] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.675178] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae30fa6b-a459-4159-9e85-a3e2921a0240',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.887694] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.887940] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.888068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.888410] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.888566] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.888721] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 is going to be updated. [ 1152.925075] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.925317] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.925405] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.925654] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.925856] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.935888] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: IN_PROGRESS for 2s [ 1153.176917] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.177184] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.177238] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.177581] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.177687] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.177849] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 is going to be updated. [ 1153.217520] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.217759] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.217759] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.217975] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.218122] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.230489] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 in Status: IN_PROGRESS for 2s [ 1154.947956] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: SUCCESS [ 1154.947956] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.027985] env[65783]: INFO networking_nsxv3.common.synchronization [req-10c7e793-21ae-421a-a517-4fae74dcefe7 req-51b718f9-29dc-4708-b19d-59b15acf3ce9 tempest-AttachInterfacesTestJSON-1497773155 tempest-AttachInterfacesTestJSON-1497773155-project-member] Enqueued Resource ID: 04bf3900-0149-4c45-92b6-cfae98a48f4e with Priority: HIGHEST for action security_group_members [ 1155.028612] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04bf3900-0149-4c45-92b6-cfae98a48f4e with Priority: HIGHEST for action security_group_members [ 1155.028943] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-04bf3900-0149-4c45-92b6-cfae98a48f4e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.028943] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.029120] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.029395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.029671] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.029671] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.029671] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.029834] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.029834] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.029934] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04bf3900-0149-4c45-92b6-cfae98a48f4e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.242162] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 in Status: SUCCESS [ 1155.242734] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.242734] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.242734] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.242975] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.243140] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.243140] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.243684] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.243684] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.243684] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.243684] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae30fa6b-a459-4159-9e85-a3e2921a0240',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.246054] env[65783]: INFO networking_nsxv3.common.synchronization [None req-cd96f38a-a59a-4d99-ad80-5e14e9ee1f89 None None] Enqueued Resource ID: 25f4ef32-ed05-4e94-bf20-6cfb545fb841 with Priority: HIGHEST for action port [ 1155.246872] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f4ef32-ed05-4e94-bf20-6cfb545fb841 with Priority: HIGHEST for action port [ 1155.247010] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-25f4ef32-ed05-4e94-bf20-6cfb545fb841 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.247213] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25f4ef32-ed05-4e94-bf20-6cfb545fb841" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.247213] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25f4ef32-ed05-4e94-bf20-6cfb545fb841" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.247443] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25f4ef32-ed05-4e94-bf20-6cfb545fb841" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.247509] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25f4ef32-ed05-4e94-bf20-6cfb545fb841',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.414720] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.416751] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.416751] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.416751] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.417614] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.417876] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.418064] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.418360] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.418551] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.418832] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1155.419058] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1155.419247] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1155.419408] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1155.419566] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1155.419717] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1155.419892] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1155.441409] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1155.441713] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1155.441880] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1155.442226] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.442657] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-fda83fac-56b6-4ab0-824a-7af792b7c8c7 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.442948] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-fda83fac-56b6-4ab0-824a-7af792b7c8c7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.443190] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-fda83fac-56b6-4ab0-824a-7af792b7c8c7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.443527] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-fda83fac-56b6-4ab0-824a-7af792b7c8c7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.443672] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fda83fac-56b6-4ab0-824a-7af792b7c8c7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.532854] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.533144] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.533144] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.533403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.533494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.533704] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.533822] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.533906] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.534212] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.534397] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.534494] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04bf3900-0149-4c45-92b6-cfae98a48f4e already deleted. [ 1155.534600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.749831] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae30fa6b-a459-4159-9e85-a3e2921a0240 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.749831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.749831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.749831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.749831] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.749831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.749831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.749831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.749831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.749831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.749831] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae30fa6b-a459-4159-9e85-a3e2921a0240 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.749831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.749831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.749831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.749831] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.749831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.750502] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.750502] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.750502] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.750502] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.750502] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae30fa6b-a459-4159-9e85-a3e2921a0240',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.752120] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 25f4ef32-ed05-4e94-bf20-6cfb545fb841 [ 1155.753649] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.754248] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.754410] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.754968] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.754968] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.754968] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:25f4ef32-ed05-4e94-bf20-6cfb545fb841 already deleted. [ 1155.754968] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25f4ef32-ed05-4e94-bf20-6cfb545fb841" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.946701] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.946931] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.947070] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.947354] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.947512] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.949059] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port fda83fac-56b6-4ab0-824a-7af792b7c8c7 not found, creating... [ 1155.949059] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.949059] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.949059] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.949059] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.949059] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.949059] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.949059] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.950911] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.950911] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.950911] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.950911] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: fda83fac-56b6-4ab0-824a-7af792b7c8c7 is going to be created. [ 1155.978281] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.979314] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.979314] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.979314] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.979314] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.979580] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-fda83fac-56b6-4ab0-824a-7af792b7c8c7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.255315] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae30fa6b-a459-4159-9e85-a3e2921a0240: rpc.has_security_group_logging(os_id): False [ 1156.277693] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.278181] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.278384] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.278713] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.279798] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.279798] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.279798] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.279798] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.279798] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.279798] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.280349] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.280611] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.280788] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.281120] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.281322] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.281634] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.281881] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.282853] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.282853] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.282853] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.282853] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 is going to be updated. [ 1156.357024] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.357024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.357024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.357024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.357024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.385032] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 in Status: IN_PROGRESS for 2s [ 1156.806527] env[65783]: INFO networking_nsxv3.common.synchronization [req-10c7e793-21ae-421a-a517-4fae74dcefe7 req-967547b1-6d2a-47cf-a203-64f089ef01c1 service nova] Enqueued Resource ID: 04bf3900-0149-4c45-92b6-cfae98a48f4e with Priority: HIGHEST for action security_group_rules [ 1156.806527] env[65783]: INFO networking_nsxv3.common.synchronization [req-10c7e793-21ae-421a-a517-4fae74dcefe7 req-967547b1-6d2a-47cf-a203-64f089ef01c1 service nova] Enqueued Resource ID: 04bf3900-0149-4c45-92b6-cfae98a48f4e with Priority: HIGHEST for action security_group_members [ 1156.806527] env[65783]: INFO networking_nsxv3.common.synchronization [req-10c7e793-21ae-421a-a517-4fae74dcefe7 req-967547b1-6d2a-47cf-a203-64f089ef01c1 service nova] Enqueued Resource ID: fda83fac-56b6-4ab0-824a-7af792b7c8c7 with Priority: HIGHEST for action port [ 1156.806527] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04bf3900-0149-4c45-92b6-cfae98a48f4e with Priority: HIGHEST for action security_group_rules [ 1156.806527] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04bf3900-0149-4c45-92b6-cfae98a48f4e with Priority: HIGHEST for action security_group_members [ 1156.807798] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fda83fac-56b6-4ab0-824a-7af792b7c8c7 with Priority: HIGHEST for action port [ 1156.808687] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04bf3900-0149-4c45-92b6-cfae98a48f4e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.812023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.812023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.812023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.812023] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04bf3900-0149-4c45-92b6-cfae98a48f4e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.812023] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-04bf3900-0149-4c45-92b6-cfae98a48f4e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.812023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.812023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.812023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.812023] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.812023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.812023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.812023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.812023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.812023] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04bf3900-0149-4c45-92b6-cfae98a48f4e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.813610] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-fda83fac-56b6-4ab0-824a-7af792b7c8c7 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.814113] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fda83fac-56b6-4ab0-824a-7af792b7c8c7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.814379] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fda83fac-56b6-4ab0-824a-7af792b7c8c7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.814711] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fda83fac-56b6-4ab0-824a-7af792b7c8c7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.814962] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fda83fac-56b6-4ab0-824a-7af792b7c8c7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.318076] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-04bf3900-0149-4c45-92b6-cfae98a48f4e taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.318348] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.318348] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04bf3900-0149-4c45-92b6-cfae98a48f4e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.320723] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fda83fac-56b6-4ab0-824a-7af792b7c8c7 with status ACTIVE [ 1157.320723] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.320723] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.320890] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.321321] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.321321] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.321321] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.321716] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.321716] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.321716] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.321716] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.321846] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.322054] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.322104] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.322970] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.322970] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.322970] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fda83fac-56b6-4ab0-824a-7af792b7c8c7 is going to be updated. [ 1157.355277] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.355435] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.355840] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.355840] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.355840] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.356019] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fda83fac-56b6-4ab0-824a-7af792b7c8c7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.821725] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04bf3900-0149-4c45-92b6-cfae98a48f4e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.952758] env[65783]: INFO networking_nsxv3.common.synchronization [None req-4d65513d-6ef7-4d71-a4a0-9ef632f1aa06 None None] Enqueued Resource ID: a02da309-1e3c-4af9-b7a1-bf2c13d67bf0 with Priority: HIGHEST for action port [ 1157.952758] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a02da309-1e3c-4af9-b7a1-bf2c13d67bf0 with Priority: HIGHEST for action port [ 1157.952758] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-a02da309-1e3c-4af9-b7a1-bf2c13d67bf0 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.952758] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a02da309-1e3c-4af9-b7a1-bf2c13d67bf0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.952758] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a02da309-1e3c-4af9-b7a1-bf2c13d67bf0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.954042] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a02da309-1e3c-4af9-b7a1-bf2c13d67bf0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.960542] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a02da309-1e3c-4af9-b7a1-bf2c13d67bf0',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.327166] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.327585] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.327585] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.327685] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.327724] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.327833] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04bf3900-0149-4c45-92b6-cfae98a48f4e is going to be created. [ 1158.400258] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.400518] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.400518] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.400819] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.401068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.405047] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 in Status: SUCCESS [ 1158.405318] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.417015] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04bf3900-0149-4c45-92b6-cfae98a48f4e in Status: UNINITIALIZED for 2s [ 1158.464304] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a02da309-1e3c-4af9-b7a1-bf2c13d67bf0 [ 1158.464562] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.464720] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.464793] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.465046] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.465147] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.465277] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a02da309-1e3c-4af9-b7a1-bf2c13d67bf0 already deleted. [ 1158.465406] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a02da309-1e3c-4af9-b7a1-bf2c13d67bf0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.433055] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04bf3900-0149-4c45-92b6-cfae98a48f4e in Status: SUCCESS [ 1160.433483] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.433543] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.433826] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.434246] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.434411] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.434520] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.434759] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.434862] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.434995] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.435142] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('04bf3900-0149-4c45-92b6-cfae98a48f4e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.937386] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('04bf3900-0149-4c45-92b6-cfae98a48f4e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.441370] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 04bf3900-0149-4c45-92b6-cfae98a48f4e: rpc.has_security_group_logging(os_id): False [ 1161.461363] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.461540] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.461596] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.461801] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.461889] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.462169] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.462284] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.462349] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.462513] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.462627] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.462770] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04bf3900-0149-4c45-92b6-cfae98a48f4e is going to be created. [ 1161.532422] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.533148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.533242] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.533762] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.533802] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.550208] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04bf3900-0149-4c45-92b6-cfae98a48f4e in Status: IN_PROGRESS for 2s [ 1162.540595] env[65783]: INFO networking_nsxv3.common.synchronization [req-537fd61e-8d41-4f93-bd66-1511ae89c60c req-048ee31f-56da-414d-a4ee-eae5dd356594 tempest-InstanceActionsNegativeTestJSON-1571355249 tempest-InstanceActionsNegativeTestJSON-1571355249-project-member] Enqueued Resource ID: 7e223089-e294-4146-bace-319372e97362 with Priority: HIGHEST for action security_group_members [ 1162.541155] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e223089-e294-4146-bace-319372e97362 with Priority: HIGHEST for action security_group_members [ 1162.541469] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e223089-e294-4146-bace-319372e97362 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.541589] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.541657] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.541901] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.543196] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.543329] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.543329] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.543491] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.543962] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.543962] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e223089-e294-4146-bace-319372e97362',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.850534] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-708 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.850745] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-708" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.850883] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-708" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.851345] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-708" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.851705] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.851792] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.851911] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.852195] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.852377] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.852558] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1162.852669] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1162.852775] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1162.852880] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1162.852984] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1162.853100] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1162.853233] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1162.872540] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1162.872694] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1162.872841] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1162.873048] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-708" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.873386] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-98f4edb9-9923-4aa2-9ee0-e4db751e1691 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.873567] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-98f4edb9-9923-4aa2-9ee0-e4db751e1691" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.873687] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-98f4edb9-9923-4aa2-9ee0-e4db751e1691" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.874012] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-98f4edb9-9923-4aa2-9ee0-e4db751e1691" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.874177] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98f4edb9-9923-4aa2-9ee0-e4db751e1691',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.046119] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.046321] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.046415] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.046669] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.046815] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.046979] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.047092] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.047150] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.047321] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.047413] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.047494] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e223089-e294-4146-bace-319372e97362 already deleted. [ 1163.047573] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.376819] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.377210] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.377367] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.377686] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.377816] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.377947] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 98f4edb9-9923-4aa2-9ee0-e4db751e1691 not found, creating... [ 1163.378267] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.378470] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.378565] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.378785] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.378926] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.379234] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.379389] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.379528] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.379753] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.380103] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.380199] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 98f4edb9-9923-4aa2-9ee0-e4db751e1691 is going to be created. [ 1163.405364] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.405947] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.405947] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.406157] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.406356] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.406588] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-98f4edb9-9923-4aa2-9ee0-e4db751e1691" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.595026] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04bf3900-0149-4c45-92b6-cfae98a48f4e in Status: SUCCESS [ 1163.595393] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.114874] env[65783]: INFO networking_nsxv3.common.synchronization [req-537fd61e-8d41-4f93-bd66-1511ae89c60c req-4dbc7d6b-0877-4303-90f1-ea3875585995 service nova] Enqueued Resource ID: 7e223089-e294-4146-bace-319372e97362 with Priority: HIGHEST for action security_group_rules [ 1164.115015] env[65783]: INFO networking_nsxv3.common.synchronization [req-537fd61e-8d41-4f93-bd66-1511ae89c60c req-4dbc7d6b-0877-4303-90f1-ea3875585995 service nova] Enqueued Resource ID: 7e223089-e294-4146-bace-319372e97362 with Priority: HIGHEST for action security_group_members [ 1164.115180] env[65783]: INFO networking_nsxv3.common.synchronization [req-537fd61e-8d41-4f93-bd66-1511ae89c60c req-4dbc7d6b-0877-4303-90f1-ea3875585995 service nova] Enqueued Resource ID: 98f4edb9-9923-4aa2-9ee0-e4db751e1691 with Priority: HIGHEST for action port [ 1164.115748] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e223089-e294-4146-bace-319372e97362 with Priority: HIGHEST for action security_group_rules [ 1164.115885] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e223089-e294-4146-bace-319372e97362 with Priority: HIGHEST for action security_group_members [ 1164.115980] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98f4edb9-9923-4aa2-9ee0-e4db751e1691 with Priority: HIGHEST for action port [ 1164.116800] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e223089-e294-4146-bace-319372e97362 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.116991] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.117072] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.117363] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.117429] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e223089-e294-4146-bace-319372e97362',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.118607] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e223089-e294-4146-bace-319372e97362 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.118732] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.118821] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.119055] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.119170] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.119295] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.119394] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.119469] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.119549] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.119659] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e223089-e294-4146-bace-319372e97362',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.121058] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-98f4edb9-9923-4aa2-9ee0-e4db751e1691 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.121058] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98f4edb9-9923-4aa2-9ee0-e4db751e1691" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.121058] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98f4edb9-9923-4aa2-9ee0-e4db751e1691" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.121058] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98f4edb9-9923-4aa2-9ee0-e4db751e1691" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.121058] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98f4edb9-9923-4aa2-9ee0-e4db751e1691',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.623684] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e223089-e294-4146-bace-319372e97362 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.623684] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.624651] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e223089-e294-4146-bace-319372e97362',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.624860] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98f4edb9-9923-4aa2-9ee0-e4db751e1691 with status ACTIVE [ 1164.625067] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.625288] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.625360] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.625535] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.625617] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.625794] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.625887] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.625989] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.626112] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.626191] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.626377] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.626471] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.626528] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.627257] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.627879] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.627879] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98f4edb9-9923-4aa2-9ee0-e4db751e1691 is going to be updated. [ 1164.649911] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.650154] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.650154] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.650282] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.650400] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.650596] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98f4edb9-9923-4aa2-9ee0-e4db751e1691" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.851648] env[65783]: INFO networking_nsxv3.common.synchronization [req-e05db2f8-365f-4c1d-8f9c-75162a787a5d req-e41fd9b4-828a-4cb0-b9db-d4313035b9d1 tempest-ServersTestJSON-581224055 tempest-ServersTestJSON-581224055-project-member] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1164.851648] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1164.851648] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.851648] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.851648] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.851648] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.851648] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.851648] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.851648] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.852081] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.852081] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.852158] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.131349] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e223089-e294-4146-bace-319372e97362',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.200184] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-334 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.200516] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-334" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.200516] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-334" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.200947] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-334" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.201206] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.201452] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.201637] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.201916] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.202159] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.202440] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1165.202607] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1165.202767] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1165.202916] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1165.203085] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1165.203260] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1165.203465] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1165.223863] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1165.224116] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1165.224414] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1165.224637] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-334" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.224997] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-4c3f94f3-891e-4229-9363-1f8123b187f7 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.225224] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-4c3f94f3-891e-4229-9363-1f8123b187f7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.225394] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-4c3f94f3-891e-4229-9363-1f8123b187f7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.225732] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-4c3f94f3-891e-4229-9363-1f8123b187f7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.225866] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c3f94f3-891e-4229-9363-1f8123b187f7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.355069] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.632183] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.632586] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.632586] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.632897] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.633025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.633269] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e223089-e294-4146-bace-319372e97362 is going to be created. [ 1165.680370] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.680582] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.680582] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.680739] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.680899] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.700420] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e223089-e294-4146-bace-319372e97362 in Status: UNINITIALIZED for 2s [ 1165.728301] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.728585] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.728724] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.729062] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.729220] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.729381] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 4c3f94f3-891e-4229-9363-1f8123b187f7 not found, creating... [ 1165.729653] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.729810] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.729936] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.730192] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.730341] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.730632] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.730788] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.730902] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.731126] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.731257] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.731415] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 4c3f94f3-891e-4229-9363-1f8123b187f7 is going to be created. [ 1165.767016] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.767319] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.767505] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.767907] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.768117] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.768489] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-4c3f94f3-891e-4229-9363-1f8123b187f7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.857269] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.360041] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.360041] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.360041] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.360316] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.360351] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.360446] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 is going to be updated. [ 1166.399399] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.399614] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.399614] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.399844] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.399893] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.411490] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: IN_PROGRESS for 2s [ 1166.513708] env[65783]: INFO networking_nsxv3.common.synchronization [req-e05db2f8-365f-4c1d-8f9c-75162a787a5d req-55eeffa3-a6e3-4754-a65d-26265d867426 service nova] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_rules [ 1166.515017] env[65783]: INFO networking_nsxv3.common.synchronization [req-e05db2f8-365f-4c1d-8f9c-75162a787a5d req-55eeffa3-a6e3-4754-a65d-26265d867426 service nova] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1166.515207] env[65783]: INFO networking_nsxv3.common.synchronization [req-e05db2f8-365f-4c1d-8f9c-75162a787a5d req-55eeffa3-a6e3-4754-a65d-26265d867426 service nova] Enqueued Resource ID: 4c3f94f3-891e-4229-9363-1f8123b187f7 with Priority: HIGHEST for action port [ 1166.515866] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_rules [ 1166.516106] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1166.516307] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c3f94f3-891e-4229-9363-1f8123b187f7 with Priority: HIGHEST for action port [ 1166.516759] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.516934] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.517122] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.517481] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.517638] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.519083] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.519250] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.519631] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c3f94f3-891e-4229-9363-1f8123b187f7 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.519835] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c3f94f3-891e-4229-9363-1f8123b187f7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.519968] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c3f94f3-891e-4229-9363-1f8123b187f7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.521878] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c3f94f3-891e-4229-9363-1f8123b187f7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.521878] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c3f94f3-891e-4229-9363-1f8123b187f7',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.023598] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.023907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.024015] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c3f94f3-891e-4229-9363-1f8123b187f7 with status ACTIVE [ 1167.024333] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.024467] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.024551] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.024807] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.024899] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.025082] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.025270] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.025339] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.025573] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.025657] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.025852] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.025945] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.026038] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.026833] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.026987] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.027105] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c3f94f3-891e-4229-9363-1f8123b187f7 is going to be updated. [ 1167.053559] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.053871] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.053871] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.053980] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.054621] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.054621] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c3f94f3-891e-4229-9363-1f8123b187f7" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.113956] env[65783]: INFO networking_nsxv3.common.synchronization [req-0eadc55d-1565-44f1-92e9-71ed5d12f247 req-ac1ca2d2-1b2c-408b-b69e-10084e80037d tempest-ServerActionsTestOtherA-298845163 tempest-ServerActionsTestOtherA-298845163-project-member] Enqueued Resource ID: aaf15510-666a-49d9-9a20-6f398b7f8216 with Priority: HIGHEST for action security_group_members [ 1167.114800] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaf15510-666a-49d9-9a20-6f398b7f8216 with Priority: HIGHEST for action security_group_members [ 1167.114925] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaf15510-666a-49d9-9a20-6f398b7f8216 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.115155] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.115292] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.115574] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.115752] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.115863] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.115927] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.116292] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.116292] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.116292] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aaf15510-666a-49d9-9a20-6f398b7f8216',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.618484] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.618707] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.618707] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.618997] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.619177] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.619425] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.619569] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.619635] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.619807] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.619888] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.619978] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aaf15510-666a-49d9-9a20-6f398b7f8216 is going to be updated. [ 1167.650909] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.651201] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.651201] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.651706] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.651706] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.662728] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaf15510-666a-49d9-9a20-6f398b7f8216 in Status: IN_PROGRESS for 2s [ 1167.712142] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e223089-e294-4146-bace-319372e97362 in Status: SUCCESS [ 1167.712565] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.712876] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.713280] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.715055] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.715055] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.715055] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.715055] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.715055] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.715055] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.715055] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e223089-e294-4146-bace-319372e97362',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.218305] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e223089-e294-4146-bace-319372e97362 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.218765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.218820] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.219089] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.219474] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.219474] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.219638] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.219742] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.219835] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.219928] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.220151] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e223089-e294-4146-bace-319372e97362 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.220259] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.220339] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.220494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.220641] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.220756] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.220847] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.220990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.221097] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.221245] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.221363] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e223089-e294-4146-bace-319372e97362',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.439136] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: SUCCESS [ 1168.439136] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.439482] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.439482] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.439690] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.439825] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.439885] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.440077] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.440148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.440278] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.723666] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e223089-e294-4146-bace-319372e97362: rpc.has_security_group_logging(os_id): False [ 1168.747720] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.747984] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.748166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.748480] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.748647] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.748996] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.749192] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.749303] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.749572] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.749695] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.749969] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.750090] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.750155] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.750310] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.750384] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.750580] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.750692] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.750757] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.750925] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.751009] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.751098] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e223089-e294-4146-bace-319372e97362 is going to be created. [ 1168.863225] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.863411] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.863483] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.863690] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.863858] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.876646] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e223089-e294-4146-bace-319372e97362 in Status: IN_PROGRESS for 2s [ 1168.942347] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.445292] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.722458] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaf15510-666a-49d9-9a20-6f398b7f8216 in Status: SUCCESS [ 1169.722458] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aaf15510-666a-49d9-9a20-6f398b7f8216 deletion is rescheduled due to dependency. [ 1169.722680] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.947612] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.947848] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.947848] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.948118] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.948208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.948259] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 is going to be updated. [ 1169.983623] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.983930] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.983930] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.984104] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.984213] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.994627] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: IN_PROGRESS for 2s [ 1170.555771] env[65783]: INFO networking_nsxv3.common.synchronization [req-2dd744ca-26e3-45ab-bc9d-9b492ebfa358 req-2e8c07ad-6140-4888-ba95-7f53c1437156 tempest-DeleteServersTestJSON-1456685968 tempest-DeleteServersTestJSON-1456685968-project-member] Enqueued Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 1170.556415] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGHEST for action security_group_members [ 1170.556919] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.557093] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.557207] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.557509] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.557759] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.557921] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.558048] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.558301] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.558465] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.558744] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.890424] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e223089-e294-4146-bace-319372e97362 in Status: SUCCESS [ 1170.890424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.062552] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.062718] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.062819] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.063024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.063112] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.063417] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.063512] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.063576] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.063719] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.063792] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.063879] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 is going to be updated. [ 1171.095742] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.096014] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.096014] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.096124] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.096292] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.107975] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: IN_PROGRESS for 2s [ 1172.008103] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: SUCCESS [ 1172.008640] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.008640] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.008907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.009210] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.009476] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.009476] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.009642] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.009707] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.009818] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.009932] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.513074] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.513256] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.513317] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.513550] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.513740] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.513842] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.513904] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.514070] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.514246] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.514290] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.515112] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.515112] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.515112] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.515112] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.515112] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.515112] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.515112] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.518908] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.518908] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.518908] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.518908] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.021277] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b22e949b-61c8-4c23-9bc8-ab00e0ad5673: rpc.has_security_group_logging(os_id): False [ 1173.041955] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.042116] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.042187] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.042434] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.042525] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.042738] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.042840] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.042900] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.043064] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.043138] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.043398] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.043496] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.043556] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.043699] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.043770] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.043944] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.044106] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.044233] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.044432] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.044525] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.044628] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 is going to be updated. [ 1173.120083] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.120083] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.120083] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.120568] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.120729] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.123834] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 in Status: SUCCESS [ 1173.123834] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 deletion is rescheduled due to dependency. [ 1173.123834] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.139471] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: IN_PROGRESS for 2s [ 1174.380351] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-702 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.380705] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-702" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.380705] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-702" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.380956] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-702" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.381268] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.381454] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.381582] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.381814] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.381977] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.382427] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1174.382543] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1174.382653] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1174.382755] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1174.382859] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1174.382959] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1174.383192] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1174.402975] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1174.403163] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1174.403297] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1174.403470] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-702" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.403787] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-dc5727b9-f909-4ed4-80d0-06ba5986f0cc taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.403986] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-dc5727b9-f909-4ed4-80d0-06ba5986f0cc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.404154] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-dc5727b9-f909-4ed4-80d0-06ba5986f0cc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.404436] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-dc5727b9-f909-4ed4-80d0-06ba5986f0cc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.404577] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc5727b9-f909-4ed4-80d0-06ba5986f0cc',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.907511] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.907511] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.907783] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.909286] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.909286] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.909286] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.909286] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.909286] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.909286] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.909691] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.909944] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.910138] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.910265] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.910497] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.910651] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.910794] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: dc5727b9-f909-4ed4-80d0-06ba5986f0cc is going to be updated. [ 1174.940416] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.941943] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.941943] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.941943] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.941943] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.941943] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-dc5727b9-f909-4ed4-80d0-06ba5986f0cc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.160087] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: SUCCESS [ 1175.160087] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.557377] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1175.557715] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1175.665334] env[65783]: INFO networking_nsxv3.common.synchronization [req-b39d2536-44b5-4d1c-a7d3-d381db03641c req-a59f6ee8-2ffb-4ba6-bc9e-8121935be6c1 service nova] Enqueued Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_rules [ 1175.665505] env[65783]: INFO networking_nsxv3.common.synchronization [req-b39d2536-44b5-4d1c-a7d3-d381db03641c req-a59f6ee8-2ffb-4ba6-bc9e-8121935be6c1 service nova] Enqueued Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_members [ 1175.665729] env[65783]: INFO networking_nsxv3.common.synchronization [req-b39d2536-44b5-4d1c-a7d3-d381db03641c req-a59f6ee8-2ffb-4ba6-bc9e-8121935be6c1 service nova] Enqueued Resource ID: dc5727b9-f909-4ed4-80d0-06ba5986f0cc with Priority: HIGHEST for action port [ 1175.666171] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_rules [ 1175.666307] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_members [ 1175.666401] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc5727b9-f909-4ed4-80d0-06ba5986f0cc with Priority: HIGHEST for action port [ 1175.666672] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c81f8cb-609b-4496-9f07-b80abbe519f8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.666786] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.666850] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.667060] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.667152] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.668432] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c81f8cb-609b-4496-9f07-b80abbe519f8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.668432] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.668684] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.668791] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.668943] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.669048] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.669112] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.669255] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.669339] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.669428] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.670520] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc5727b9-f909-4ed4-80d0-06ba5986f0cc taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.670627] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc5727b9-f909-4ed4-80d0-06ba5986f0cc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.670692] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc5727b9-f909-4ed4-80d0-06ba5986f0cc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.670842] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc5727b9-f909-4ed4-80d0-06ba5986f0cc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.670925] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc5727b9-f909-4ed4-80d0-06ba5986f0cc',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.829340] env[65783]: INFO networking_nsxv3.common.synchronization [None req-7e8149cf-e70f-4ce0-90d8-b7ee95062a2d None None] Enqueued Resource ID: ab0075bc-08b2-4ed2-8476-bbedda76fe85 with Priority: HIGHEST for action port [ 1175.830452] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab0075bc-08b2-4ed2-8476-bbedda76fe85 with Priority: HIGHEST for action port [ 1175.830606] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab0075bc-08b2-4ed2-8476-bbedda76fe85 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.830671] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab0075bc-08b2-4ed2-8476-bbedda76fe85" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.830773] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab0075bc-08b2-4ed2-8476-bbedda76fe85" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.831143] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab0075bc-08b2-4ed2-8476-bbedda76fe85" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.831143] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab0075bc-08b2-4ed2-8476-bbedda76fe85',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.173352] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.174448] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c81f8cb-609b-4496-9f07-b80abbe519f8 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.174611] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.174757] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc5727b9-f909-4ed4-80d0-06ba5986f0cc with status ACTIVE [ 1176.175112] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.175112] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.175112] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.175830] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.175830] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.175830] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.175830] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.175830] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.175830] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.176146] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.178487] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.178487] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.178487] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.178487] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.178767] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.178767] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc5727b9-f909-4ed4-80d0-06ba5986f0cc is going to be updated. [ 1176.204040] env[65783]: INFO networking_nsxv3.common.synchronization [req-0a68aed1-4791-4ae8-8be2-3aa306de556d req-bb63b4e2-98d0-4f2c-a1bd-e7f0a0473b32 tempest-InstanceActionsNegativeTestJSON-1571355249 tempest-InstanceActionsNegativeTestJSON-1571355249-project-member] Enqueued Resource ID: 7e223089-e294-4146-bace-319372e97362 with Priority: HIGHEST for action security_group_members [ 1176.205053] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.205053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.205053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.205053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.205053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.205053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc5727b9-f909-4ed4-80d0-06ba5986f0cc" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.206287] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e223089-e294-4146-bace-319372e97362 with Priority: HIGHEST for action security_group_members [ 1176.206287] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e223089-e294-4146-bace-319372e97362 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.206287] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.206287] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.206287] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.206287] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.206711] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.206711] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.206711] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.206711] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.206822] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e223089-e294-4146-bace-319372e97362',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.333502] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ab0075bc-08b2-4ed2-8476-bbedda76fe85 [ 1176.333721] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.333832] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.333832] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.334069] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.334163] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.334350] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ab0075bc-08b2-4ed2-8476-bbedda76fe85 already deleted. [ 1176.334442] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab0075bc-08b2-4ed2-8476-bbedda76fe85" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.682356] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.709276] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.709474] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.709536] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.710728] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.710728] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.710728] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.710728] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.710728] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.710728] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.710728] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.710728] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e223089-e294-4146-bace-319372e97362 is going to be updated. [ 1176.755948] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.755948] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.755948] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.755948] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.756251] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.769913] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e223089-e294-4146-bace-319372e97362 in Status: IN_PROGRESS for 2s [ 1177.185478] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.185634] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.185669] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.187206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.187206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.187206] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 is going to be updated. [ 1177.222032] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.222218] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.222355] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.222458] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.222679] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.236351] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: IN_PROGRESS for 2s [ 1178.787136] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e223089-e294-4146-bace-319372e97362 in Status: SUCCESS [ 1178.787498] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e223089-e294-4146-bace-319372e97362 deletion is rescheduled due to dependency. [ 1178.787604] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.251465] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: SUCCESS [ 1179.251465] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.251465] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.251465] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.251465] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.251465] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.251465] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.251465] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.251465] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.251465] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.251465] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.465424] env[65783]: INFO networking_nsxv3.common.synchronization [req-b85bca84-2d37-4f90-9361-2db3e44b8f3d req-e819d3ff-602a-45f1-99cc-dca51de783d4 tempest-ServerRescueTestJSON-1826206369 tempest-ServerRescueTestJSON-1826206369-project-member] Enqueued Resource ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 with Priority: HIGHEST for action security_group_members [ 1179.466279] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 with Priority: HIGHEST for action security_group_members [ 1179.466403] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae30fa6b-a459-4159-9e85-a3e2921a0240 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.466512] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.466586] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.466799] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.466950] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.467257] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.467257] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.467434] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.467528] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.467623] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae30fa6b-a459-4159-9e85-a3e2921a0240',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.753452] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.969838] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae30fa6b-a459-4159-9e85-a3e2921a0240',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.256042] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c81f8cb-609b-4496-9f07-b80abbe519f8: rpc.has_security_group_logging(os_id): False [ 1180.278746] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.278995] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.279709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.279709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.279709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.279709] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.279935] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.279935] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.280103] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.280158] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.280256] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 is going to be updated. [ 1180.353573] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.353573] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.353573] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.353573] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.353573] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.367779] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: IN_PROGRESS for 2s [ 1180.477587] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae30fa6b-a459-4159-9e85-a3e2921a0240',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.841989] env[65783]: INFO networking_nsxv3.common.synchronization [None req-dfc4efab-dc9a-46f4-b298-86acac861b49 None None] Enqueued Resource ID: da8fbd75-ad5f-4f7d-801b-e657eb812f6f with Priority: HIGHEST for action port [ 1180.842640] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da8fbd75-ad5f-4f7d-801b-e657eb812f6f with Priority: HIGHEST for action port [ 1180.842979] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-da8fbd75-ad5f-4f7d-801b-e657eb812f6f taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.844088] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da8fbd75-ad5f-4f7d-801b-e657eb812f6f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.844509] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da8fbd75-ad5f-4f7d-801b-e657eb812f6f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.844834] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da8fbd75-ad5f-4f7d-801b-e657eb812f6f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.845086] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da8fbd75-ad5f-4f7d-801b-e657eb812f6f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.947836] env[65783]: INFO networking_nsxv3.common.synchronization [req-22bf1762-de74-4d7b-82b0-d07a96f8372c req-0f0b9669-b815-43e3-9d7a-4916ef054e32 tempest-ServersTestJSON-581224055 tempest-ServersTestJSON-581224055-project-member] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1180.949454] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1180.949817] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.950086] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.950272] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.950544] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.951104] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.951354] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.951354] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.951552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.952134] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.952415] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.980792] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.981154] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.981154] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.981395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.981395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.981453] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 is going to be updated. [ 1181.020085] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.020574] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.020773] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.021049] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.021225] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.038690] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 in Status: IN_PROGRESS for 2s [ 1181.317323] env[65783]: INFO networking_nsxv3.common.synchronization [req-28bc5844-8dff-4e5c-892c-8aeb2c1d2949 req-a8ccf3e3-b635-459f-83c0-29aa622f8d7d tempest-AttachVolumeTestJSON-999763968 tempest-AttachVolumeTestJSON-999763968-project-member] Enqueued Resource ID: 6cc4f190-878a-48bb-a700-45297dd58d68 with Priority: HIGHEST for action security_group_members [ 1181.317323] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cc4f190-878a-48bb-a700-45297dd58d68 with Priority: HIGHEST for action security_group_members [ 1181.317323] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cc4f190-878a-48bb-a700-45297dd58d68 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.318843] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.319107] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.323223] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.323223] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.323223] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.323223] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.323223] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.323223] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.323223] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cc4f190-878a-48bb-a700-45297dd58d68',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.348307] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port da8fbd75-ad5f-4f7d-801b-e657eb812f6f [ 1181.348532] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.348672] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.348744] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.349472] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.349472] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.349472] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:da8fbd75-ad5f-4f7d-801b-e657eb812f6f already deleted. [ 1181.349472] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da8fbd75-ad5f-4f7d-801b-e657eb812f6f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.457904] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.825198] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.825441] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.825521] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.825784] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.825900] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.826182] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.826329] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.827230] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.827230] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.827338] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.827501] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cc4f190-878a-48bb-a700-45297dd58d68 is going to be updated. [ 1181.862045] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.862133] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.862280] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.862543] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.862736] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.874075] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cc4f190-878a-48bb-a700-45297dd58d68 in Status: IN_PROGRESS for 2s [ 1181.959632] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.384403] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: SUCCESS [ 1182.384403] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.461901] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.463053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.463053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.463053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.463251] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.463480] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 is going to be updated. [ 1182.529430] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.529619] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.529675] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.529985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.536248] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.549103] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: IN_PROGRESS for 2s [ 1183.052010] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 in Status: SUCCESS [ 1183.052233] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.662599] env[65783]: INFO networking_nsxv3.common.synchronization [None req-612b9c5a-d43d-4cb5-a03d-863eab118ea8 None None] Enqueued Resource ID: d4746acf-7f2f-485d-9883-4dfdfb40e681 with Priority: HIGHEST for action port [ 1183.663692] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4746acf-7f2f-485d-9883-4dfdfb40e681 with Priority: HIGHEST for action port [ 1183.663692] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4746acf-7f2f-485d-9883-4dfdfb40e681 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.663692] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4746acf-7f2f-485d-9883-4dfdfb40e681" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.663918] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4746acf-7f2f-485d-9883-4dfdfb40e681" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.664244] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4746acf-7f2f-485d-9883-4dfdfb40e681" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.664415] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4746acf-7f2f-485d-9883-4dfdfb40e681',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.888802] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cc4f190-878a-48bb-a700-45297dd58d68 in Status: SUCCESS [ 1183.888802] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cc4f190-878a-48bb-a700-45297dd58d68 deletion is rescheduled due to dependency. [ 1183.888802] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.168447] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d4746acf-7f2f-485d-9883-4dfdfb40e681 [ 1184.168447] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.168447] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.168447] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.168447] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.168447] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.168447] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d4746acf-7f2f-485d-9883-4dfdfb40e681 already deleted. [ 1184.168447] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4746acf-7f2f-485d-9883-4dfdfb40e681" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.567668] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: SUCCESS [ 1184.567896] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.455383] env[65783]: INFO networking_nsxv3.common.synchronization [req-61e2ea5b-9024-4e4c-bf7e-ff3bd5349cd8 req-727c0127-dc91-41d8-ae5e-fe7c32ae4811 tempest-ServerRescueTestJSON-1826206369 tempest-ServerRescueTestJSON-1826206369-project-member] Enqueued Resource ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 with Priority: HIGHEST for action security_group_members [ 1188.456107] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 with Priority: HIGHEST for action security_group_members [ 1188.456553] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae30fa6b-a459-4159-9e85-a3e2921a0240 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.456734] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.456828] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.457079] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.457266] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.457388] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.457459] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.457651] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.457747] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.457851] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae30fa6b-a459-4159-9e85-a3e2921a0240',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.963663] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.963840] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.963911] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.964166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.964260] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.964495] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.964585] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.964653] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.964806] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.964882] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.964967] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 is going to be updated. [ 1189.030983] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.031262] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.031377] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.031743] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.032096] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.043558] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 in Status: IN_PROGRESS for 2s [ 1191.058616] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 in Status: SUCCESS [ 1191.058924] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 deletion is rescheduled due to dependency. [ 1191.058924] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.288410] env[65783]: INFO networking_nsxv3.common.synchronization [req-12f7c810-2456-43b7-8a55-1e4412db1119 req-6253e03c-1546-43d6-94d9-829fa189a8f4 tempest-ServerPasswordTestJSON-1934956593 tempest-ServerPasswordTestJSON-1934956593-project-member] Enqueued Resource ID: 2efb684a-08ee-44d1-aaa1-abe589dfc483 with Priority: HIGHEST for action security_group_members [ 1191.288963] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2efb684a-08ee-44d1-aaa1-abe589dfc483 with Priority: HIGHEST for action security_group_members [ 1191.289281] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2efb684a-08ee-44d1-aaa1-abe589dfc483 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.289405] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.289478] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.290092] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.290092] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.290092] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.290092] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.290259] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.290259] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.291205] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2efb684a-08ee-44d1-aaa1-abe589dfc483',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.682171] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-80 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.682563] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-80" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.682711] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-80" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.683052] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-80" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.683331] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.683497] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.683638] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.683833] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.683979] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.684206] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1191.684322] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1191.684486] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1191.684599] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1191.684712] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1191.685621] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1191.685798] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1191.708657] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1191.708842] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1191.709024] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1191.709181] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-80" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.710523] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-b7dbcca3-428b-4b01-9903-f12350d7be4d taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.710523] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-b7dbcca3-428b-4b01-9903-f12350d7be4d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.710523] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-b7dbcca3-428b-4b01-9903-f12350d7be4d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.710523] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-b7dbcca3-428b-4b01-9903-f12350d7be4d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.710523] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7dbcca3-428b-4b01-9903-f12350d7be4d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.792481] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.792686] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.792796] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.793018] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.793144] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.793362] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.793488] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.793570] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.793746] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.793844] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.793946] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2efb684a-08ee-44d1-aaa1-abe589dfc483 already deleted. [ 1191.794080] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.214153] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.214703] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.214703] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.214987] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.215250] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.215510] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port b7dbcca3-428b-4b01-9903-f12350d7be4d not found, creating... [ 1192.215959] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.216192] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.216405] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.216577] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.216773] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.217228] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.217500] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.217700] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.218058] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.218260] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.218474] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: b7dbcca3-428b-4b01-9903-f12350d7be4d is going to be created. [ 1192.245951] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.246247] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.246310] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.246559] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.246819] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.247064] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-b7dbcca3-428b-4b01-9903-f12350d7be4d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.965462] env[65783]: INFO networking_nsxv3.common.synchronization [req-12f7c810-2456-43b7-8a55-1e4412db1119 req-38765231-4f32-499a-ada4-50f1a21c3511 service nova] Enqueued Resource ID: 2efb684a-08ee-44d1-aaa1-abe589dfc483 with Priority: HIGHEST for action security_group_rules [ 1192.965638] env[65783]: INFO networking_nsxv3.common.synchronization [req-12f7c810-2456-43b7-8a55-1e4412db1119 req-38765231-4f32-499a-ada4-50f1a21c3511 service nova] Enqueued Resource ID: 2efb684a-08ee-44d1-aaa1-abe589dfc483 with Priority: HIGHEST for action security_group_members [ 1192.966076] env[65783]: INFO networking_nsxv3.common.synchronization [req-12f7c810-2456-43b7-8a55-1e4412db1119 req-38765231-4f32-499a-ada4-50f1a21c3511 service nova] Enqueued Resource ID: b7dbcca3-428b-4b01-9903-f12350d7be4d with Priority: HIGHEST for action port [ 1192.966371] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2efb684a-08ee-44d1-aaa1-abe589dfc483 with Priority: HIGHEST for action security_group_rules [ 1192.966516] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2efb684a-08ee-44d1-aaa1-abe589dfc483 with Priority: HIGHEST for action security_group_members [ 1192.966713] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7dbcca3-428b-4b01-9903-f12350d7be4d with Priority: HIGHEST for action port [ 1192.966926] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2efb684a-08ee-44d1-aaa1-abe589dfc483 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.967074] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.967183] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.967435] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.967529] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2efb684a-08ee-44d1-aaa1-abe589dfc483',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.968551] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2efb684a-08ee-44d1-aaa1-abe589dfc483 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.968616] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.968686] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.968876] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.969034] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.969133] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.969193] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.969371] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.969437] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.969534] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2efb684a-08ee-44d1-aaa1-abe589dfc483',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.970443] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7dbcca3-428b-4b01-9903-f12350d7be4d taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.970550] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7dbcca3-428b-4b01-9903-f12350d7be4d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.970615] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7dbcca3-428b-4b01-9903-f12350d7be4d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.970764] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7dbcca3-428b-4b01-9903-f12350d7be4d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.970843] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7dbcca3-428b-4b01-9903-f12350d7be4d',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.000378] env[65783]: INFO networking_nsxv3.common.synchronization [req-793f618d-5cd7-4a7b-a123-71812b641f24 req-0b818aee-d157-46e1-baf7-8d4e4a2de29a tempest-ServersTestJSON-581224055 tempest-ServersTestJSON-581224055-project-member] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1193.000959] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1193.001298] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.001421] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.001484] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.001678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.001828] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.001929] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.001987] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.002149] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.002230] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.002405] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.315365] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-334 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.315696] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-334" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.315739] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-334" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.316019] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-334" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.316293] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.316451] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.316568] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.316864] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.317041] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.317250] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1193.317369] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1193.317470] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1193.317576] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1193.317681] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1193.317784] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1193.317910] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1193.336228] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1193.336392] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1193.336577] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1193.336721] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-334" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.337115] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-7bd8a945-5b5b-43be-8383-f403522245b3 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.337299] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-7bd8a945-5b5b-43be-8383-f403522245b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.337421] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-7bd8a945-5b5b-43be-8383-f403522245b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.337743] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-7bd8a945-5b5b-43be-8383-f403522245b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.337881] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bd8a945-5b5b-43be-8383-f403522245b3',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.473281] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2efb684a-08ee-44d1-aaa1-abe589dfc483',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.473793] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2efb684a-08ee-44d1-aaa1-abe589dfc483 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.473943] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.474143] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7dbcca3-428b-4b01-9903-f12350d7be4d with status ACTIVE [ 1193.474356] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.474650] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.474650] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.474903] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.474969] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.475607] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.475607] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.475607] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.475607] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.475607] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.475909] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.475909] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.475909] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.476058] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.476125] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.477449] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7dbcca3-428b-4b01-9903-f12350d7be4d is going to be updated. [ 1193.497348] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.497522] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.497567] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.497770] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.497870] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.498063] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7dbcca3-428b-4b01-9903-f12350d7be4d" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.504806] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.767634] env[65783]: INFO networking_nsxv3.common.synchronization [req-cbc13ac4-b582-4bf0-b8c6-4395e10797f5 req-9b9cae4f-05c3-4c30-9e60-00895e8e607b tempest-ServerActionsTestOtherB-29394606 tempest-ServerActionsTestOtherB-29394606-project-member] Enqueued Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_members [ 1193.768236] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGHEST for action security_group_members [ 1193.768837] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c81f8cb-609b-4496-9f07-b80abbe519f8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.768837] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.768837] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.769025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.769063] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.769208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.769264] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.769373] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.769673] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.769673] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.840635] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.840958] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.840958] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.841255] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.841407] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.841605] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 7bd8a945-5b5b-43be-8383-f403522245b3 not found, creating... [ 1193.841888] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.842098] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.842253] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.842575] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.842717] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.843013] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.843180] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.843298] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.843508] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.843644] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.843782] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 7bd8a945-5b5b-43be-8383-f403522245b3 is going to be created. [ 1193.877193] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.877406] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.877622] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.877926] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.878176] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.879232] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-7bd8a945-5b5b-43be-8383-f403522245b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.979231] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2efb684a-08ee-44d1-aaa1-abe589dfc483',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.009066] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.272270] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.272479] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.272479] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.272721] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.272817] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.273033] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.273145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.273194] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.273349] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.273439] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.273513] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 is going to be updated. [ 1194.308681] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.308891] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.309014] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.309186] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.309431] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.319178] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: IN_PROGRESS for 2s [ 1194.480592] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.482091] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.482091] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.482091] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.482091] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.482091] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2efb684a-08ee-44d1-aaa1-abe589dfc483 is going to be created. [ 1194.515336] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.515533] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.515634] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.515810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.516384] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.517236] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.517375] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.517424] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.517576] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.517656] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.517749] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 is going to be updated. [ 1194.532787] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2efb684a-08ee-44d1-aaa1-abe589dfc483 in Status: UNINITIALIZED for 2s [ 1194.554480] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.554480] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.554480] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.554480] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.554693] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.566547] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: IN_PROGRESS for 2s [ 1194.578475] env[65783]: INFO networking_nsxv3.common.synchronization [req-793f618d-5cd7-4a7b-a123-71812b641f24 req-8bc11cbf-a338-4719-9291-1ffe717b3374 service nova] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_rules [ 1194.578475] env[65783]: INFO networking_nsxv3.common.synchronization [req-793f618d-5cd7-4a7b-a123-71812b641f24 req-8bc11cbf-a338-4719-9291-1ffe717b3374 service nova] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1194.578577] env[65783]: INFO networking_nsxv3.common.synchronization [req-793f618d-5cd7-4a7b-a123-71812b641f24 req-8bc11cbf-a338-4719-9291-1ffe717b3374 service nova] Enqueued Resource ID: 7bd8a945-5b5b-43be-8383-f403522245b3 with Priority: HIGHEST for action port [ 1194.579319] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_rules [ 1194.579481] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1194.579554] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bd8a945-5b5b-43be-8383-f403522245b3 with Priority: HIGHEST for action port [ 1194.579838] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.579954] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.580023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.580412] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.580497] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.581584] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.581679] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.581811] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-7bd8a945-5b5b-43be-8383-f403522245b3 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.582200] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7bd8a945-5b5b-43be-8383-f403522245b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.582258] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7bd8a945-5b5b-43be-8383-f403522245b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.582628] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7bd8a945-5b5b-43be-8383-f403522245b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.582760] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bd8a945-5b5b-43be-8383-f403522245b3',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.085687] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.085886] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.086064] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7bd8a945-5b5b-43be-8383-f403522245b3 with status ACTIVE [ 1195.086296] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.086405] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.086466] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.086777] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.086859] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.087035] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.087138] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.087201] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.087366] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.087444] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.087627] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.087720] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.087781] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.087918] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.087989] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.088086] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7bd8a945-5b5b-43be-8383-f403522245b3 is going to be updated. [ 1195.111239] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.111786] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.111786] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.111786] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.111786] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.111944] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7bd8a945-5b5b-43be-8383-f403522245b3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.332712] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 in Status: SUCCESS [ 1196.332712] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 deletion is rescheduled due to dependency. [ 1196.332712] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.572333] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2efb684a-08ee-44d1-aaa1-abe589dfc483 in Status: SUCCESS [ 1196.572647] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.572765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.573047] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.573226] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.573481] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.573481] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.573603] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.573696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.573793] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.573891] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2efb684a-08ee-44d1-aaa1-abe589dfc483',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.576394] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: SUCCESS [ 1196.576394] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.576394] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.576394] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.576394] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.576651] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.576651] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.576651] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.576792] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.576822] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.655972] env[65783]: INFO networking_nsxv3.common.synchronization [req-0968132b-73f3-49f3-bdd2-ef012d036f00 req-4527ac85-52f2-4dcf-af5d-19bdbed0a6a3 tempest-AttachVolumeNegativeTest-1814624860 tempest-AttachVolumeNegativeTest-1814624860-project-member] Enqueued Resource ID: f2f8650e-b3af-426f-9fae-30baa4cb3e2c with Priority: HIGHEST for action security_group_members [ 1196.656315] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2f8650e-b3af-426f-9fae-30baa4cb3e2c with Priority: HIGHEST for action security_group_members [ 1196.657337] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2f8650e-b3af-426f-9fae-30baa4cb3e2c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.657486] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.658014] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.658014] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.658142] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.658142] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.658235] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.658470] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.659249] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.659249] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2f8650e-b3af-426f-9fae-30baa4cb3e2c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.079024] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2efb684a-08ee-44d1-aaa1-abe589dfc483 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.079024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.079024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.079024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.079362] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.079362] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.079362] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.079497] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.079532] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.079622] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.079771] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2efb684a-08ee-44d1-aaa1-abe589dfc483 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.079863] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.079923] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.080444] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.080599] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.080697] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.080761] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.080916] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.080995] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.081111] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.081228] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2efb684a-08ee-44d1-aaa1-abe589dfc483',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.082207] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.163423] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.167690] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.167690] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.167690] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.167690] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.167690] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.167690] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.167690] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.167690] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.167690] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.167690] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2f8650e-b3af-426f-9fae-30baa4cb3e2c is going to be updated. [ 1197.197727] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.197727] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.197727] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.197955] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.198099] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.208643] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2f8650e-b3af-426f-9fae-30baa4cb3e2c in Status: IN_PROGRESS for 2s [ 1197.584230] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2efb684a-08ee-44d1-aaa1-abe589dfc483: rpc.has_security_group_logging(os_id): False [ 1197.585543] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.604958] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.605130] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.605199] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.605412] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.605502] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.605723] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.605815] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.605879] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.606040] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.606118] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.606506] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.606506] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.606506] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.606617] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.606647] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.606825] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.607178] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.607178] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.607178] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.607178] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.607337] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2efb684a-08ee-44d1-aaa1-abe589dfc483 is going to be created. [ 1197.683501] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.683687] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.683687] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.683843] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.684030] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.699450] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2efb684a-08ee-44d1-aaa1-abe589dfc483 in Status: IN_PROGRESS for 2s [ 1198.092082] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.092082] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.092082] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.092082] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.092082] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.092082] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 is going to be updated. [ 1198.125744] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.126055] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.126166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.126419] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.126604] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.139598] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: IN_PROGRESS for 2s [ 1199.220673] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2f8650e-b3af-426f-9fae-30baa4cb3e2c in Status: SUCCESS [ 1199.221138] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2f8650e-b3af-426f-9fae-30baa4cb3e2c deletion is rescheduled due to dependency. [ 1199.221138] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.713067] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2efb684a-08ee-44d1-aaa1-abe589dfc483 in Status: SUCCESS [ 1199.713067] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.153679] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: SUCCESS [ 1200.154115] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.154598] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.154906] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.155132] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.155306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.155374] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.155814] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.155900] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.155994] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.156103] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.659669] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.660047] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.660047] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.660132] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.660310] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.660412] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.660479] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.660634] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.660762] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.660870] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.661038] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.661134] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.661194] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.661335] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.661471] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.661564] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.661625] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.661760] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.661832] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.661911] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.661998] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.164612] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b22e949b-61c8-4c23-9bc8-ab00e0ad5673: rpc.has_security_group_logging(os_id): False [ 1201.187414] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.187614] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.187697] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.187914] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.188067] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.188221] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.188327] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.188397] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.188558] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.188622] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.188850] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.188956] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.189032] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.189186] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.189268] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.189659] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.189766] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.189842] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.190053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.190178] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.190299] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 is going to be updated. [ 1201.255126] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.255360] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.255360] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.255637] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.255800] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.270645] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: IN_PROGRESS for 2s [ 1201.657209] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1201.657347] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1203.039012] env[65783]: INFO networking_nsxv3.common.synchronization [None req-9a72348c-02d2-414f-a5b1-322f25f9be70 tempest-AttachVolumeNegativeTest-1814624860 tempest-AttachVolumeNegativeTest-1814624860-project-member] Enqueued Resource ID: db3246d5-b700-4207-b606-2833b93da8c8 with Priority: HIGHEST for action security_group_rules [ 1203.039568] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db3246d5-b700-4207-b606-2833b93da8c8 with Priority: HIGHEST for action security_group_rules [ 1203.039835] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db3246d5-b700-4207-b606-2833b93da8c8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.039987] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.040082] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.040413] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.040514] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db3246d5-b700-4207-b606-2833b93da8c8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.147566] env[65783]: INFO networking_nsxv3.common.synchronization [None req-d349816d-2718-4e9e-a0a7-5c5e192a93d4 tempest-AttachVolumeNegativeTest-1814624860 tempest-AttachVolumeNegativeTest-1814624860-project-member] Enqueued Resource ID: db3246d5-b700-4207-b606-2833b93da8c8 with Priority: HIGHEST for action security_group_rules [ 1203.148177] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db3246d5-b700-4207-b606-2833b93da8c8 with Priority: HIGHEST for action security_group_rules [ 1203.148491] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db3246d5-b700-4207-b606-2833b93da8c8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.148604] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.300229] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: SUCCESS [ 1203.300525] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.575797] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.575797] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.575797] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.575797] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.575797] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.576076] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db3246d5-b700-4207-b606-2833b93da8c8 already deleted. [ 1203.576107] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.576276] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.576465] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.576569] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db3246d5-b700-4207-b606-2833b93da8c8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.100807] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.101159] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.101159] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.101434] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.101566] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.101706] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db3246d5-b700-4207-b606-2833b93da8c8 already deleted. [ 1204.101827] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.817313] env[65783]: INFO networking_nsxv3.common.synchronization [req-95ae989d-1470-433b-809f-41d36dff6ae1 req-fdbf287d-b655-4f79-ac6b-56c4b91bf80e tempest-ServerPasswordTestJSON-1934956593 tempest-ServerPasswordTestJSON-1934956593-project-member] Enqueued Resource ID: 2efb684a-08ee-44d1-aaa1-abe589dfc483 with Priority: HIGHEST for action security_group_members [ 1204.821022] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2efb684a-08ee-44d1-aaa1-abe589dfc483 with Priority: HIGHEST for action security_group_members [ 1204.821022] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-2efb684a-08ee-44d1-aaa1-abe589dfc483 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.821022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.821022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.821022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.821022] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.821022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.821022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.821022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.821022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.821022] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2efb684a-08ee-44d1-aaa1-abe589dfc483',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.321606] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.322262] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.322262] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.322569] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.322569] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.322727] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.322828] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.322892] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.323138] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.323228] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.323291] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2efb684a-08ee-44d1-aaa1-abe589dfc483 is going to be updated. [ 1205.353716] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.353998] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.353998] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.354189] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.354311] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.367442] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2efb684a-08ee-44d1-aaa1-abe589dfc483 in Status: IN_PROGRESS for 2s [ 1205.839144] env[65783]: INFO networking_nsxv3.common.synchronization [None req-4cfa36a1-2eee-4ebb-9b94-82cb5063acca tempest-ServerActionsTestJSON-316964864 tempest-ServerActionsTestJSON-316964864-project-member] Enqueued Resource ID: ab77afc1-ca2d-4d03-8596-057f87dcdf4e with Priority: HIGHEST for action security_group_rules [ 1205.839700] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab77afc1-ca2d-4d03-8596-057f87dcdf4e with Priority: HIGHEST for action security_group_rules [ 1205.840061] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab77afc1-ca2d-4d03-8596-057f87dcdf4e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.840243] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.840355] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.840721] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.840859] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab77afc1-ca2d-4d03-8596-057f87dcdf4e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.933338] env[65783]: INFO networking_nsxv3.common.synchronization [None req-52027f6c-e8b2-4690-92c8-db353848da38 tempest-ServerActionsTestJSON-316964864 tempest-ServerActionsTestJSON-316964864-project-member] Enqueued Resource ID: ab77afc1-ca2d-4d03-8596-057f87dcdf4e with Priority: HIGHEST for action security_group_rules [ 1205.933948] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab77afc1-ca2d-4d03-8596-057f87dcdf4e with Priority: HIGHEST for action security_group_rules [ 1205.934382] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab77afc1-ca2d-4d03-8596-057f87dcdf4e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.934524] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.361979] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.362310] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.362310] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.362475] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.362563] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.363115] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab77afc1-ca2d-4d03-8596-057f87dcdf4e already deleted. [ 1206.363115] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.363115] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.363115] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.363384] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab77afc1-ca2d-4d03-8596-057f87dcdf4e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.884867] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.885033] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.885107] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.885334] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.885662] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.885779] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab77afc1-ca2d-4d03-8596-057f87dcdf4e already deleted. [ 1206.885900] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.380530] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2efb684a-08ee-44d1-aaa1-abe589dfc483 in Status: SUCCESS [ 1207.380930] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2efb684a-08ee-44d1-aaa1-abe589dfc483 deletion is rescheduled due to dependency. [ 1207.380996] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.796541] env[65783]: INFO networking_nsxv3.common.synchronization [req-d043ad5b-3c58-4de8-ac46-ec848230abb3 req-b3c27fd4-11e5-46f2-a45d-50ba154fdace tempest-ServersTestJSON-581224055 tempest-ServersTestJSON-581224055-project-member] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1208.796988] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1208.797185] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.797334] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.797506] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.797752] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.797955] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.798105] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.798174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.798352] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.798465] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.798587] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.108302] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-334 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.108525] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-334" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.108884] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-334" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.109190] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-334" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.109461] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.109627] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.109741] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.109953] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.110106] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.110310] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1209.110421] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1209.110525] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1209.110634] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1209.110737] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1209.110840] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1209.110966] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1209.134776] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1209.134959] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1209.135095] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1209.135270] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-334" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.135589] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-c703390b-d2a4-4b35-b51c-9b66c1714fb2 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.135759] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-c703390b-d2a4-4b35-b51c-9b66c1714fb2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.135873] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-c703390b-d2a4-4b35-b51c-9b66c1714fb2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.136219] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-c703390b-d2a4-4b35-b51c-9b66c1714fb2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.136414] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c703390b-d2a4-4b35-b51c-9b66c1714fb2',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.300937] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.638685] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.638910] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.638957] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.639271] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.639445] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.639617] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port c703390b-d2a4-4b35-b51c-9b66c1714fb2 not found, creating... [ 1209.639896] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.640062] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.640200] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.640423] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.640630] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.640898] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.641138] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.641267] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.641486] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.641649] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.641790] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: c703390b-d2a4-4b35-b51c-9b66c1714fb2 is going to be created. [ 1209.662395] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.662663] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.662747] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.663048] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.663280] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.663505] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-c703390b-d2a4-4b35-b51c-9b66c1714fb2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.803413] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.029810] env[65783]: INFO networking_nsxv3.common.synchronization [req-daa5d515-78f8-40cb-8c26-26a33b4d5856 req-6a473df0-ffb8-4186-b080-8c994c19c795 tempest-AttachInterfacesTestJSON-1497773155 tempest-AttachInterfacesTestJSON-1497773155-project-member] Enqueued Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_members [ 1210.030725] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_members [ 1210.031290] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.031501] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.031604] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.031831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.032028] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.032134] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.032198] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.032384] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.032440] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.032549] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.305516] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.305696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.305742] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.306142] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.306142] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.306142] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 is going to be updated. [ 1210.341794] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.342020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.342020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.342264] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.342509] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.354246] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: IN_PROGRESS for 2s [ 1210.376305] env[65783]: INFO networking_nsxv3.common.synchronization [req-d043ad5b-3c58-4de8-ac46-ec848230abb3 req-51a4e7a6-cc5c-451d-a845-9ee677cb5ba0 service nova] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_rules [ 1210.376471] env[65783]: INFO networking_nsxv3.common.synchronization [req-d043ad5b-3c58-4de8-ac46-ec848230abb3 req-51a4e7a6-cc5c-451d-a845-9ee677cb5ba0 service nova] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1210.376607] env[65783]: INFO networking_nsxv3.common.synchronization [req-d043ad5b-3c58-4de8-ac46-ec848230abb3 req-51a4e7a6-cc5c-451d-a845-9ee677cb5ba0 service nova] Enqueued Resource ID: c703390b-d2a4-4b35-b51c-9b66c1714fb2 with Priority: HIGHEST for action port [ 1210.377728] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.377885] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.378017] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.378283] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.378539] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.378699] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.378812] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.379033] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.379183] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.379387] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1210.379502] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1210.379635] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1210.379748] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1210.379862] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1210.379967] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1210.380108] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1210.381673] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_rules [ 1210.384580] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1210.384580] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c703390b-d2a4-4b35-b51c-9b66c1714fb2 with Priority: HIGHEST for action port [ 1210.384580] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.384580] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.384580] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.384580] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.384580] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.384580] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.384580] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.384580] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-c703390b-d2a4-4b35-b51c-9b66c1714fb2 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.385011] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c703390b-d2a4-4b35-b51c-9b66c1714fb2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.385011] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c703390b-d2a4-4b35-b51c-9b66c1714fb2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.385011] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c703390b-d2a4-4b35-b51c-9b66c1714fb2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.385011] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c703390b-d2a4-4b35-b51c-9b66c1714fb2',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.403092] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1210.403282] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1210.403425] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1210.403672] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.404147] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-c720474e-625c-4e3a-8654-dcfc4227f500 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.404323] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-c720474e-625c-4e3a-8654-dcfc4227f500" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.404355] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-c720474e-625c-4e3a-8654-dcfc4227f500" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.404701] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-c720474e-625c-4e3a-8654-dcfc4227f500" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.404839] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c720474e-625c-4e3a-8654-dcfc4227f500',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.535996] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.536216] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.536275] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.536501] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.536599] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.536865] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.537113] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.537113] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.537214] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.537252] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.537337] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce is going to be updated. [ 1210.567331] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.567557] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.567557] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.567785] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.567872] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.577581] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: IN_PROGRESS for 2s [ 1210.884536] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.884842] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.888080] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c703390b-d2a4-4b35-b51c-9b66c1714fb2 with status ACTIVE [ 1210.888289] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.888416] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.888506] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.888733] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.888820] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.888993] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.889147] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.889192] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.889307] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.889381] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.889561] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.889653] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.889713] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.889850] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.889921] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.890013] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c703390b-d2a4-4b35-b51c-9b66c1714fb2 is going to be updated. [ 1210.907800] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.908109] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.908303] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.908658] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.908867] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.909084] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port c720474e-625c-4e3a-8654-dcfc4227f500 not found, creating... [ 1210.909431] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.909539] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.909655] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.909877] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.910014] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.910299] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.910525] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.910652] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.910859] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.910993] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.911161] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: c720474e-625c-4e3a-8654-dcfc4227f500 is going to be created. [ 1210.913012] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.913141] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.913213] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.913365] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.913486] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.913634] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c703390b-d2a4-4b35-b51c-9b66c1714fb2" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.941044] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.941278] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.941403] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.941690] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.941917] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.942160] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-c720474e-625c-4e3a-8654-dcfc4227f500" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.066359] env[65783]: INFO networking_nsxv3.common.synchronization [req-f8daa762-f3b3-4080-ac69-faa59d0fd8da req-11ac1ea6-5ea2-4f18-963b-cbf3eb62f5d5 tempest-AttachVolumeNegativeTest-1814624860 tempest-AttachVolumeNegativeTest-1814624860-project-member] Enqueued Resource ID: db3246d5-b700-4207-b606-2833b93da8c8 with Priority: HIGHEST for action security_group_members [ 1211.066907] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db3246d5-b700-4207-b606-2833b93da8c8 with Priority: HIGHEST for action security_group_members [ 1211.067224] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-db3246d5-b700-4207-b606-2833b93da8c8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.067346] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.067415] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.067828] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.067999] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.068114] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.068174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.068337] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.068420] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.068514] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db3246d5-b700-4207-b606-2833b93da8c8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.395209] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-552 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.395391] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-552" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.395534] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-552" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.395848] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-552" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.396128] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.396287] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.396402] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.396811] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.396811] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.396936] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1211.397060] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1211.397171] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1211.397276] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1211.397382] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1211.397493] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1211.397646] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1211.416995] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1211.417154] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1211.417294] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1211.417472] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-552" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.417782] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-f42a00fc-23eb-4df0-a834-72750f41e45f taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.417975] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-f42a00fc-23eb-4df0-a834-72750f41e45f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.418079] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-f42a00fc-23eb-4df0-a834-72750f41e45f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.418403] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-f42a00fc-23eb-4df0-a834-72750f41e45f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.418554] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f42a00fc-23eb-4df0-a834-72750f41e45f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.572283] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.572283] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.572283] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.572283] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.572283] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.572283] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.572283] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.572283] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.572283] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.572283] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.572283] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db3246d5-b700-4207-b606-2833b93da8c8 already deleted. [ 1211.572283] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.615429] env[65783]: INFO networking_nsxv3.common.synchronization [req-daa5d515-78f8-40cb-8c26-26a33b4d5856 req-eae4a57e-87f6-416c-aab5-e15239ed002c service nova] Enqueued Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_rules [ 1211.615627] env[65783]: INFO networking_nsxv3.common.synchronization [req-daa5d515-78f8-40cb-8c26-26a33b4d5856 req-eae4a57e-87f6-416c-aab5-e15239ed002c service nova] Enqueued Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_members [ 1211.615766] env[65783]: INFO networking_nsxv3.common.synchronization [req-daa5d515-78f8-40cb-8c26-26a33b4d5856 req-eae4a57e-87f6-416c-aab5-e15239ed002c service nova] Enqueued Resource ID: c720474e-625c-4e3a-8654-dcfc4227f500 with Priority: HIGHEST for action port [ 1211.616370] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_rules [ 1211.616517] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_members [ 1211.616630] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c720474e-625c-4e3a-8654-dcfc4227f500 with Priority: HIGHEST for action port [ 1211.616941] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.617091] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.617164] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.617373] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.617454] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.618290] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.618387] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.618602] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-c720474e-625c-4e3a-8654-dcfc4227f500 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.618716] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c720474e-625c-4e3a-8654-dcfc4227f500" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.618786] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c720474e-625c-4e3a-8654-dcfc4227f500" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.619620] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c720474e-625c-4e3a-8654-dcfc4227f500" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.619620] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c720474e-625c-4e3a-8654-dcfc4227f500',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.920714] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.920966] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.921069] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.921352] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.921503] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.921658] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port f42a00fc-23eb-4df0-a834-72750f41e45f not found, creating... [ 1211.921962] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.922123] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.922237] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.922437] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.922575] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.922859] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.923023] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.923135] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.923339] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.923470] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.923606] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: f42a00fc-23eb-4df0-a834-72750f41e45f is going to be created. [ 1211.944683] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.944934] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.945070] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.945352] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.945575] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.945962] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-f42a00fc-23eb-4df0-a834-72750f41e45f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.121383] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.121383] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.121566] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c720474e-625c-4e3a-8654-dcfc4227f500 with status ACTIVE [ 1212.121766] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.121885] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.121951] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.122186] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.122278] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.122447] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.122584] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.122690] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.122934] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.123087] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.123374] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.123526] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.123677] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.123837] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.123918] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.124015] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c720474e-625c-4e3a-8654-dcfc4227f500 is going to be updated. [ 1212.151459] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.151669] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.151669] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.151865] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.152016] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.152181] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c720474e-625c-4e3a-8654-dcfc4227f500" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.365226] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: SUCCESS [ 1212.365503] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.365702] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.365950] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.366158] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.366294] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.366362] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.366518] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.366603] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.366699] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.589433] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: SUCCESS [ 1212.589677] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce deletion is rescheduled due to dependency. [ 1212.589753] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.589905] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.590173] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.590377] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.590500] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.590567] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.590914] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.591017] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.591122] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.695073] env[65783]: INFO networking_nsxv3.common.synchronization [req-f8daa762-f3b3-4080-ac69-faa59d0fd8da req-bed15855-33ef-4cc4-801c-83cb99ddfae0 service nova] Enqueued Resource ID: db3246d5-b700-4207-b606-2833b93da8c8 with Priority: HIGHEST for action security_group_rules [ 1212.695676] env[65783]: INFO networking_nsxv3.common.synchronization [req-f8daa762-f3b3-4080-ac69-faa59d0fd8da req-bed15855-33ef-4cc4-801c-83cb99ddfae0 service nova] Enqueued Resource ID: db3246d5-b700-4207-b606-2833b93da8c8 with Priority: HIGHEST for action security_group_members [ 1212.695676] env[65783]: INFO networking_nsxv3.common.synchronization [req-f8daa762-f3b3-4080-ac69-faa59d0fd8da req-bed15855-33ef-4cc4-801c-83cb99ddfae0 service nova] Enqueued Resource ID: f42a00fc-23eb-4df0-a834-72750f41e45f with Priority: HIGHEST for action port [ 1212.696388] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db3246d5-b700-4207-b606-2833b93da8c8 with Priority: HIGHEST for action security_group_rules [ 1212.696526] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db3246d5-b700-4207-b606-2833b93da8c8 with Priority: HIGHEST for action security_group_members [ 1212.696625] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f42a00fc-23eb-4df0-a834-72750f41e45f with Priority: HIGHEST for action port [ 1212.697248] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db3246d5-b700-4207-b606-2833b93da8c8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.697382] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.697382] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.697543] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.697611] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db3246d5-b700-4207-b606-2833b93da8c8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.698521] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-db3246d5-b700-4207-b606-2833b93da8c8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.698656] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.698736] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.698958] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.699047] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.699142] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.699220] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.699330] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.699399] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.699492] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db3246d5-b700-4207-b606-2833b93da8c8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.703457] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-f42a00fc-23eb-4df0-a834-72750f41e45f taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.703457] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f42a00fc-23eb-4df0-a834-72750f41e45f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.703457] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f42a00fc-23eb-4df0-a834-72750f41e45f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.703457] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f42a00fc-23eb-4df0-a834-72750f41e45f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.703719] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f42a00fc-23eb-4df0-a834-72750f41e45f',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.869512] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.092963] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.203702] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('db3246d5-b700-4207-b606-2833b93da8c8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.205670] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-db3246d5-b700-4207-b606-2833b93da8c8 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.205670] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.205862] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f42a00fc-23eb-4df0-a834-72750f41e45f with status ACTIVE [ 1213.206023] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.206139] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.206205] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.206415] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.206499] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.206668] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.206764] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.206847] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.207158] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.207250] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.207557] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.207749] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.207808] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.208076] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.208177] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.208429] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f42a00fc-23eb-4df0-a834-72750f41e45f is going to be updated. [ 1213.240269] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.240449] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.240531] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.240757] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.240893] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.241143] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f42a00fc-23eb-4df0-a834-72750f41e45f" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.376172] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.596427] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.711472] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('db3246d5-b700-4207-b606-2833b93da8c8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.880123] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.880368] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.880489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.880814] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.880957] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.881110] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 is going to be updated. [ 1213.921205] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.921548] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.921715] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.921967] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.922177] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.935718] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: IN_PROGRESS for 2s [ 1214.099434] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.099729] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.099729] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.099877] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.099969] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.100078] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce is going to be updated. [ 1214.132099] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.132099] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.132099] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.132099] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.132099] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.141655] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: IN_PROGRESS for 2s [ 1214.213567] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.213876] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.213876] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.214024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.214125] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.214281] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db3246d5-b700-4207-b606-2833b93da8c8 is going to be created. [ 1214.244189] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.244189] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.244189] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.244189] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.244487] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.259698] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db3246d5-b700-4207-b606-2833b93da8c8 in Status: UNINITIALIZED for 2s [ 1215.151592] env[65783]: INFO networking_nsxv3.common.synchronization [req-fc486e9b-60ad-4aa2-86da-9a78d7b04f08 req-66bde7ca-f349-473d-ad9d-e1807343c87e tempest-ServerActionsTestJSON-316964864 tempest-ServerActionsTestJSON-316964864-project-member] Enqueued Resource ID: ab77afc1-ca2d-4d03-8596-057f87dcdf4e with Priority: HIGHEST for action security_group_members [ 1215.152281] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab77afc1-ca2d-4d03-8596-057f87dcdf4e with Priority: HIGHEST for action security_group_members [ 1215.152427] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab77afc1-ca2d-4d03-8596-057f87dcdf4e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.152628] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.152628] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.152934] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.153945] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.153945] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.153945] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.153945] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.153945] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.153945] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab77afc1-ca2d-4d03-8596-057f87dcdf4e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.532720] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.532930] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.533112] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.533456] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.533823] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.534018] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.534360] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.534360] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.534500] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.534776] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1215.534886] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1215.535027] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1215.535160] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1215.535282] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1215.535390] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1215.535521] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1215.559780] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1215.559987] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1215.560100] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1215.560261] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.560577] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-fff8c844-a1fe-4657-9ab0-99fa3a35d346 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.560743] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-fff8c844-a1fe-4657-9ab0-99fa3a35d346" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.560868] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-fff8c844-a1fe-4657-9ab0-99fa3a35d346" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.561291] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-fff8c844-a1fe-4657-9ab0-99fa3a35d346" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.561428] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fff8c844-a1fe-4657-9ab0-99fa3a35d346',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.656300] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.656483] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.656483] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.656630] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.657204] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.657204] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.657204] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.657204] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.657496] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.657496] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.657496] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab77afc1-ca2d-4d03-8596-057f87dcdf4e already deleted. [ 1215.657597] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.946403] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: SUCCESS [ 1215.946629] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.946803] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.947037] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.947234] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.947352] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.947417] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.947584] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.947660] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.947745] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.947837] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.064135] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.064448] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.064658] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.064990] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.065213] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.065373] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port fff8c844-a1fe-4657-9ab0-99fa3a35d346 not found, creating... [ 1216.065670] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.065835] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.065955] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.066194] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.066328] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.066608] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.066761] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.066880] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.067098] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.067229] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.067366] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: fff8c844-a1fe-4657-9ab0-99fa3a35d346 is going to be created. [ 1216.089090] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.089320] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.089443] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.089718] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.089942] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.090181] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-fff8c844-a1fe-4657-9ab0-99fa3a35d346" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.158733] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: SUCCESS [ 1216.159128] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.159229] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.159440] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.159631] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.160093] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.160093] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.160093] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.160257] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.160257] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.160375] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.271337] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db3246d5-b700-4207-b606-2833b93da8c8 in Status: SUCCESS [ 1216.271541] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.271664] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.271905] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.272128] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.272260] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.272320] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.272450] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.272568] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.272667] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.272762] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('db3246d5-b700-4207-b606-2833b93da8c8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.451066] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.451066] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.451066] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.451066] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.451066] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.451066] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.451066] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.451066] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.451928] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.451928] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.451928] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.451928] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.451928] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.451928] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.451928] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.452478] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.452478] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.452478] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.452478] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.452478] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.452478] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.662810] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.663052] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.663111] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.663336] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.663543] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.663634] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.663679] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.663834] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.663922] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.664025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.664178] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.664846] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.664846] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.664846] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.664846] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.664846] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.664846] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.665641] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.665641] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.665641] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.665641] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.775250] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('db3246d5-b700-4207-b606-2833b93da8c8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.851727] env[65783]: INFO networking_nsxv3.common.synchronization [req-fc486e9b-60ad-4aa2-86da-9a78d7b04f08 req-29825890-c377-4b6c-9702-96275212a704 service nova] Enqueued Resource ID: ab77afc1-ca2d-4d03-8596-057f87dcdf4e with Priority: HIGHEST for action security_group_rules [ 1216.851918] env[65783]: INFO networking_nsxv3.common.synchronization [req-fc486e9b-60ad-4aa2-86da-9a78d7b04f08 req-29825890-c377-4b6c-9702-96275212a704 service nova] Enqueued Resource ID: ab77afc1-ca2d-4d03-8596-057f87dcdf4e with Priority: HIGHEST for action security_group_members [ 1216.852072] env[65783]: INFO networking_nsxv3.common.synchronization [req-fc486e9b-60ad-4aa2-86da-9a78d7b04f08 req-29825890-c377-4b6c-9702-96275212a704 service nova] Enqueued Resource ID: fff8c844-a1fe-4657-9ab0-99fa3a35d346 with Priority: HIGHEST for action port [ 1216.852740] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab77afc1-ca2d-4d03-8596-057f87dcdf4e with Priority: HIGHEST for action security_group_rules [ 1216.852866] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab77afc1-ca2d-4d03-8596-057f87dcdf4e with Priority: HIGHEST for action security_group_members [ 1216.852969] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fff8c844-a1fe-4657-9ab0-99fa3a35d346 with Priority: HIGHEST for action port [ 1216.853414] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab77afc1-ca2d-4d03-8596-057f87dcdf4e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.853539] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.853636] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.853825] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.853911] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab77afc1-ca2d-4d03-8596-057f87dcdf4e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.854906] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab77afc1-ca2d-4d03-8596-057f87dcdf4e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.855185] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.855249] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.855533] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.855691] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.855837] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.855917] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.856084] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.856187] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.856284] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab77afc1-ca2d-4d03-8596-057f87dcdf4e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.857970] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-fff8c844-a1fe-4657-9ab0-99fa3a35d346 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.858129] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fff8c844-a1fe-4657-9ab0-99fa3a35d346" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.858189] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fff8c844-a1fe-4657-9ab0-99fa3a35d346" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.858370] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fff8c844-a1fe-4657-9ab0-99fa3a35d346" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.858452] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fff8c844-a1fe-4657-9ab0-99fa3a35d346',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.954761] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b22e949b-61c8-4c23-9bc8-ab00e0ad5673: rpc.has_security_group_logging(os_id): False [ 1216.973745] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.973902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.973972] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.974939] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.974939] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.974939] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.974939] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.974939] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.974939] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.974939] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.975287] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.975287] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.975366] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.975488] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.975552] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.975787] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.975932] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.975932] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.976121] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.976162] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.976218] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 is going to be updated. [ 1217.051114] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.051334] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.051380] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.051656] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.051842] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.075748] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: IN_PROGRESS for 2s [ 1217.168128] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e3bc25c3-f702-4fff-a8a0-27dd0dc43dce: rpc.has_security_group_logging(os_id): False [ 1217.194015] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.194192] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.194273] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.194607] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.194741] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.195672] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.195672] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.195672] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.195672] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.195672] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.195985] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.195985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.196138] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.196208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.196381] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.196488] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.196645] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.196645] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.197073] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.197073] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.197073] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce is going to be updated. [ 1217.272018] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.272018] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.272018] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.272018] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.272018] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.278156] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for db3246d5-b700-4207-b606-2833b93da8c8: rpc.has_security_group_logging(os_id): False [ 1217.294529] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: IN_PROGRESS for 2s [ 1217.301705] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.301792] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.301838] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.302077] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.302132] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.302375] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.302502] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.302565] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.302720] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.302798] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.302890] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db3246d5-b700-4207-b606-2833b93da8c8 is going to be created. [ 1217.360386] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab77afc1-ca2d-4d03-8596-057f87dcdf4e taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.360555] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.360754] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab77afc1-ca2d-4d03-8596-057f87dcdf4e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.362637] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fff8c844-a1fe-4657-9ab0-99fa3a35d346 with status ACTIVE [ 1217.363397] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.365028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.365028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.365119] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.365208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.365912] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.366059] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.366106] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.366914] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.366914] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.366914] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.366914] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.366914] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.366914] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.366914] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.367316] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fff8c844-a1fe-4657-9ab0-99fa3a35d346 is going to be updated. [ 1217.422931] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.423540] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.423629] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.423856] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.424442] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.431581] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.431759] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.431799] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.432041] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.432177] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.432361] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fff8c844-a1fe-4657-9ab0-99fa3a35d346" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.445384] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db3246d5-b700-4207-b606-2833b93da8c8 in Status: IN_PROGRESS for 2s [ 1217.606169] env[65783]: INFO networking_nsxv3.common.synchronization [None req-53974132-b712-4d89-9999-7daa8e762f30 tempest-AttachInterfacesTestJSON-1497773155 tempest-AttachInterfacesTestJSON-1497773155-project-member] Enqueued Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_members [ 1217.606169] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_members [ 1217.606169] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.606169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.606169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.606169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.606169] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.606476] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.606476] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.606556] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.606644] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.606742] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.869264] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab77afc1-ca2d-4d03-8596-057f87dcdf4e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.109038] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.371934] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.372346] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.372346] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.372440] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.372589] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.372728] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab77afc1-ca2d-4d03-8596-057f87dcdf4e is going to be created. [ 1218.398187] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.398413] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.398413] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.398607] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.398761] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.409591] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab77afc1-ca2d-4d03-8596-057f87dcdf4e in Status: UNINITIALIZED for 2s [ 1218.611247] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.115028] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: SUCCESS [ 1219.115311] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.115744] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.115887] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.115944] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.116161] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.116242] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.116332] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce is going to be updated. [ 1219.174045] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.174045] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.174045] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.174045] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.174045] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.192414] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: IN_PROGRESS for 2s [ 1219.332407] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: SUCCESS [ 1219.332680] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.457489] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db3246d5-b700-4207-b606-2833b93da8c8 in Status: SUCCESS [ 1219.457848] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.832024] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.832024] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.832024] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.832024] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.832024] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.832024] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.832024] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.832024] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.832024] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.832024] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1219.833184] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1219.833440] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1219.833672] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1219.833887] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1219.834107] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1219.834334] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1219.854875] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1219.854875] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1219.855774] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1219.856205] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.857108] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-114649fa-5d38-4198-8cf6-45044b37f249 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.860737] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-114649fa-5d38-4198-8cf6-45044b37f249" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.860737] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-114649fa-5d38-4198-8cf6-45044b37f249" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.860737] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-114649fa-5d38-4198-8cf6-45044b37f249" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.860737] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('114649fa-5d38-4198-8cf6-45044b37f249',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.965702] env[65783]: INFO networking_nsxv3.common.synchronization [req-115aeae1-4486-461f-a386-325f383557e5 req-21748ced-2f2b-45d1-a4a8-034c10890c17 tempest-ServersTestJSON-581224055 tempest-ServersTestJSON-581224055-project-member] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1219.966470] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1219.966776] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.966930] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.967090] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.967219] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.967384] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.967487] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.967568] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.967766] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.967861] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.968065] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.362813] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.363067] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.363186] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.363480] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.363669] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.363831] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port 114649fa-5d38-4198-8cf6-45044b37f249 not found, creating... [ 1220.364121] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.364277] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.364393] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.364698] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.364841] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.365140] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.365296] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.365412] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.365654] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.365794] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.365936] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: 114649fa-5d38-4198-8cf6-45044b37f249 is going to be created. [ 1220.395302] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.395505] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.395627] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.396334] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.396592] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.396824] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-114649fa-5d38-4198-8cf6-45044b37f249" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.420298] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab77afc1-ca2d-4d03-8596-057f87dcdf4e in Status: SUCCESS [ 1220.420502] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.420670] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.420885] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.421088] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.421206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.421271] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.421421] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.421500] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.421586] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.421676] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab77afc1-ca2d-4d03-8596-057f87dcdf4e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.471925] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.923729] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab77afc1-ca2d-4d03-8596-057f87dcdf4e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.973633] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.088080] env[65783]: INFO networking_nsxv3.common.synchronization [req-59c9da07-8b6c-41a3-9199-1df5ae1fccf5 req-67de24c6-66cc-4d37-837f-e748c5d47e8e service nova] Enqueued Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_rules [ 1221.088080] env[65783]: INFO networking_nsxv3.common.synchronization [req-59c9da07-8b6c-41a3-9199-1df5ae1fccf5 req-67de24c6-66cc-4d37-837f-e748c5d47e8e service nova] Enqueued Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_members [ 1221.088080] env[65783]: INFO networking_nsxv3.common.synchronization [req-59c9da07-8b6c-41a3-9199-1df5ae1fccf5 req-67de24c6-66cc-4d37-837f-e748c5d47e8e service nova] Enqueued Resource ID: 114649fa-5d38-4198-8cf6-45044b37f249 with Priority: HIGHEST for action port [ 1221.088080] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_rules [ 1221.088080] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_members [ 1221.088080] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 114649fa-5d38-4198-8cf6-45044b37f249 with Priority: HIGHEST for action port [ 1221.088080] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.088616] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.088616] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.088678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.088788] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.090028] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.090028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.090208] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-114649fa-5d38-4198-8cf6-45044b37f249 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.090281] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-114649fa-5d38-4198-8cf6-45044b37f249" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.090281] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-114649fa-5d38-4198-8cf6-45044b37f249" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.090958] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-114649fa-5d38-4198-8cf6-45044b37f249" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.090958] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('114649fa-5d38-4198-8cf6-45044b37f249',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.202424] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: SUCCESS [ 1221.202644] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.202855] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.203031] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.203228] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.203343] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.203402] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.203557] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.203637] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.203728] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.426059] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab77afc1-ca2d-4d03-8596-057f87dcdf4e: rpc.has_security_group_logging(os_id): False [ 1221.444097] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.444250] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.444324] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.444586] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.444696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.444960] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.445077] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.445141] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.445305] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.445381] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.445480] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab77afc1-ca2d-4d03-8596-057f87dcdf4e is going to be created. [ 1221.476199] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.476586] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.476586] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.476730] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.476890] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.477058] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 is going to be updated. [ 1221.509870] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.510075] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.510159] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.510389] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.510616] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.512549] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.512687] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.512758] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.512938] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.513087] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.524807] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: IN_PROGRESS for 2s [ 1221.526721] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab77afc1-ca2d-4d03-8596-057f87dcdf4e in Status: IN_PROGRESS for 2s [ 1221.592567] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.592825] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.592942] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 114649fa-5d38-4198-8cf6-45044b37f249 with status ACTIVE [ 1221.593148] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.593286] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.593348] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.593618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.593734] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.593918] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.594045] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.594115] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.594272] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.594364] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.594943] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.595078] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.595145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.595317] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.595395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.595494] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 114649fa-5d38-4198-8cf6-45044b37f249 is going to be updated. [ 1221.626843] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.627129] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.627205] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.627426] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.627567] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.627722] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-114649fa-5d38-4198-8cf6-45044b37f249" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.706683] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.208776] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.711793] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.712303] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.712303] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.712395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.712471] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.712601] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce is going to be updated. [ 1222.745081] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.745299] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.745299] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.745536] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.745712] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.756788] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: IN_PROGRESS for 2s [ 1222.865942] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-738 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.866152] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-738" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.866274] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-738" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.866553] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-738" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.866915] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.867050] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.867203] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.867431] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.867639] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.867859] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1222.867972] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1222.868094] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1222.868709] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1222.868844] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1222.868971] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1222.869107] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1222.889733] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1222.890033] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1222.890132] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1222.890313] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-738" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.890629] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-c6074f79-c6f2-4186-b2c3-809f045737ed taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.890803] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-c6074f79-c6f2-4186-b2c3-809f045737ed" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.890926] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-c6074f79-c6f2-4186-b2c3-809f045737ed" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.892048] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-c6074f79-c6f2-4186-b2c3-809f045737ed" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.892048] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6074f79-c6f2-4186-b2c3-809f045737ed',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.394624] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.394624] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.394624] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.394624] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.394927] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.395033] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.395198] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.395317] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.395535] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.395696] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.395989] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.396160] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.396278] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.396494] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.396629] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.396769] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: c6074f79-c6f2-4186-b2c3-809f045737ed is going to be updated. [ 1223.420057] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.420303] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.420471] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.420778] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.421028] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.421299] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-c6074f79-c6f2-4186-b2c3-809f045737ed" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.536682] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: SUCCESS [ 1223.536682] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.538822] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab77afc1-ca2d-4d03-8596-057f87dcdf4e in Status: SUCCESS [ 1223.539059] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.100311] env[65783]: INFO networking_nsxv3.common.synchronization [req-8262f9be-a6db-4ed1-8da9-f278d0fe6d13 req-7ed1d6a6-0053-4b03-a7f3-cbf747614bd5 service nova] Enqueued Resource ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 with Priority: HIGHEST for action security_group_rules [ 1224.100311] env[65783]: INFO networking_nsxv3.common.synchronization [req-8262f9be-a6db-4ed1-8da9-f278d0fe6d13 req-7ed1d6a6-0053-4b03-a7f3-cbf747614bd5 service nova] Enqueued Resource ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 with Priority: HIGHEST for action security_group_members [ 1224.100578] env[65783]: INFO networking_nsxv3.common.synchronization [req-8262f9be-a6db-4ed1-8da9-f278d0fe6d13 req-7ed1d6a6-0053-4b03-a7f3-cbf747614bd5 service nova] Enqueued Resource ID: c6074f79-c6f2-4186-b2c3-809f045737ed with Priority: HIGHEST for action port [ 1224.100886] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 with Priority: HIGHEST for action security_group_rules [ 1224.101020] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 with Priority: HIGHEST for action security_group_members [ 1224.101110] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6074f79-c6f2-4186-b2c3-809f045737ed with Priority: HIGHEST for action port [ 1224.101384] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb5a0c7c-b375-4d79-8e33-962a90b59498 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.103463] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.103463] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.103463] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.103463] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb5a0c7c-b375-4d79-8e33-962a90b59498',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.103848] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb5a0c7c-b375-4d79-8e33-962a90b59498 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.103848] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.103848] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.103969] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.104102] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.104166] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.104206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.105084] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.105084] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.105084] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb5a0c7c-b375-4d79-8e33-962a90b59498',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.105671] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6074f79-c6f2-4186-b2c3-809f045737ed taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.105784] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6074f79-c6f2-4186-b2c3-809f045737ed" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.105849] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6074f79-c6f2-4186-b2c3-809f045737ed" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.106016] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6074f79-c6f2-4186-b2c3-809f045737ed" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.106321] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6074f79-c6f2-4186-b2c3-809f045737ed',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.608022] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb5a0c7c-b375-4d79-8e33-962a90b59498 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.608241] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.608404] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6074f79-c6f2-4186-b2c3-809f045737ed with status ACTIVE [ 1224.608584] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.608693] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.608759] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.608974] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.609085] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.609411] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.609411] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.609411] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.609574] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.609653] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.609933] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.609933] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.610143] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.610143] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.610200] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.610277] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6074f79-c6f2-4186-b2c3-809f045737ed is going to be updated. [ 1224.611418] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb5a0c7c-b375-4d79-8e33-962a90b59498',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.632331] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.632603] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.632724] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.633027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.633170] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.633359] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6074f79-c6f2-4186-b2c3-809f045737ed" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.769521] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: SUCCESS [ 1224.769756] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.769937] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.770173] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.770372] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.770519] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.770639] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.770796] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.770897] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.771012] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.771115] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.113761] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb5a0c7c-b375-4d79-8e33-962a90b59498',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.273029] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.273222] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.273269] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.273495] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.273663] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.273783] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.273831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.273965] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.274058] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.274140] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.274290] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.274499] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.274499] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.274610] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.274728] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.274830] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.274882] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.275022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.275102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.275190] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.275278] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.617109] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.617109] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.617109] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.617109] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.617109] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.617109] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 is going to be updated. [ 1225.653151] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.653373] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.653373] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.653568] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.653707] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.664558] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 in Status: IN_PROGRESS for 2s [ 1225.777808] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e3bc25c3-f702-4fff-a8a0-27dd0dc43dce: rpc.has_security_group_logging(os_id): False [ 1225.798584] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.798788] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.798788] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.798943] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.799045] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.799266] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.799368] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.799431] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.799594] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.799671] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.799845] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.799939] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.800008] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.800153] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.800226] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.800403] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.800498] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.800558] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.800742] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.800826] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.800927] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce is going to be updated. [ 1225.867924] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.868145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.868145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.868350] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.868487] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.883017] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: IN_PROGRESS for 2s [ 1227.676066] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 in Status: SUCCESS [ 1227.676480] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.676480] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.676576] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.676735] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.676837] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.676988] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.677252] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.677349] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.677445] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.677541] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb5a0c7c-b375-4d79-8e33-962a90b59498',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.900666] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: SUCCESS [ 1227.900944] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.179841] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb5a0c7c-b375-4d79-8e33-962a90b59498',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.325158] env[65783]: INFO networking_nsxv3.common.synchronization [req-1ef09e60-5d4c-40db-8eb9-654376d59a69 req-dfdb26c0-4cfa-4732-9ec6-1ef1fafec370 tempest-ServersTestJSON-581224055 tempest-ServersTestJSON-581224055-project-member] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1228.325949] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1228.326439] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.326618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.326723] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.327021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.327255] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.327414] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.327518] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.327759] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.328033] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.328204] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.682157] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb5a0c7c-b375-4d79-8e33-962a90b59498: rpc.has_security_group_logging(os_id): False [ 1228.708023] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.708273] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.708273] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.708472] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.708564] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.708817] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.708919] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.708984] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.709152] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.709246] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.709347] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 is going to be updated. [ 1228.802194] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.802465] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.802568] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.802945] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.803140] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.830185] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.834110] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 in Status: IN_PROGRESS for 2s [ 1229.333080] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.835532] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.835948] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.835948] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.836154] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.836260] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.836376] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 is going to be updated. [ 1229.871461] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.871653] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.871698] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.871919] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.872086] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.881864] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: IN_PROGRESS for 2s [ 1230.849251] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 in Status: SUCCESS [ 1230.849251] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.892497] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: SUCCESS [ 1231.892876] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.327151] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1233.327567] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1235.073159] env[65783]: INFO networking_nsxv3.common.synchronization [req-336e0c12-0a97-4ec0-98ea-5bed9950c180 req-209585d8-505d-47ca-a34c-b40108b788df tempest-AttachInterfacesTestJSON-1497773155 tempest-AttachInterfacesTestJSON-1497773155-project-member] Enqueued Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_members [ 1235.073414] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_members [ 1235.073516] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.073613] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.073680] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.073873] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.074033] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.074265] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.074265] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.074344] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.074406] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.075031] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.577113] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.079924] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.204993] env[65783]: INFO networking_nsxv3.common.synchronization [None req-a7ab0bfe-2854-4354-bd48-de239960c810 tempest-AttachInterfacesTestJSON-1497773155 tempest-AttachInterfacesTestJSON-1497773155-project-member] Enqueued Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_members [ 1236.205614] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_members [ 1236.206206] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.206399] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.583679] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.584124] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.584124] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.584124] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.584304] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.584379] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce is going to be updated. [ 1236.619775] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.619961] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.620021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.620268] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.620417] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.630397] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: IN_PROGRESS for 2s [ 1237.168996] env[65783]: INFO networking_nsxv3.common.synchronization [req-4a4488b3-d62f-498b-aef9-ac17e9ae8fa4 req-4077f965-5047-48ab-b052-a0aa1e0538a5 tempest-ServersTestJSON-581224055 tempest-ServersTestJSON-581224055-project-member] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1237.169507] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1237.169856] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.170052] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.170129] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.170296] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.170471] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.170559] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.170629] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.170782] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.170883] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.171190] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.530756] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-334 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.530976] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-334" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.531102] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-334" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.531382] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-334" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.531764] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.531951] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.532084] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.532312] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.532453] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.532735] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1237.532908] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1237.533068] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1237.533184] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1237.533299] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1237.533407] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1237.533537] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1237.554089] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1237.554274] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1237.554417] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1237.554608] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-334" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.555031] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-b9563bd8-34ff-48e6-9804-3643714bb99a taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.555220] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-b9563bd8-34ff-48e6-9804-3643714bb99a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.555340] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-b9563bd8-34ff-48e6-9804-3643714bb99a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.555708] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-b9563bd8-34ff-48e6-9804-3643714bb99a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.555865] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9563bd8-34ff-48e6-9804-3643714bb99a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.673167] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.058236] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.058439] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.058565] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.058855] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.059033] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.059172] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port b9563bd8-34ff-48e6-9804-3643714bb99a not found, creating... [ 1238.059428] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.059583] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.059698] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.059920] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.060068] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.060348] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.060503] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.060616] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.060862] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.061012] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.061160] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: b9563bd8-34ff-48e6-9804-3643714bb99a is going to be created. [ 1238.080591] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.080836] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.080904] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.081194] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.081504] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.081736] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-b9563bd8-34ff-48e6-9804-3643714bb99a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.175863] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.639216] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: SUCCESS [ 1238.639445] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.639615] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.639845] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.640047] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.640178] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.640243] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.640401] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.640482] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.640601] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.678119] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.678297] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.678382] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.678676] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.678676] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.678781] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 is going to be updated. [ 1238.719676] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.719950] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.720131] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.720814] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.720814] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.732207] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: IN_PROGRESS for 2s [ 1238.821542] env[65783]: INFO networking_nsxv3.common.synchronization [req-4a4488b3-d62f-498b-aef9-ac17e9ae8fa4 req-a8344cf6-5e75-48a6-a0a4-ad61fd1e45c6 service nova] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_rules [ 1238.821862] env[65783]: INFO networking_nsxv3.common.synchronization [req-4a4488b3-d62f-498b-aef9-ac17e9ae8fa4 req-a8344cf6-5e75-48a6-a0a4-ad61fd1e45c6 service nova] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1238.822068] env[65783]: INFO networking_nsxv3.common.synchronization [req-4a4488b3-d62f-498b-aef9-ac17e9ae8fa4 req-a8344cf6-5e75-48a6-a0a4-ad61fd1e45c6 service nova] Enqueued Resource ID: b9563bd8-34ff-48e6-9804-3643714bb99a with Priority: HIGHEST for action port [ 1238.823355] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_rules [ 1238.823355] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1238.823355] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9563bd8-34ff-48e6-9804-3643714bb99a with Priority: HIGHEST for action port [ 1238.824192] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.824192] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.824192] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.824192] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.824192] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.825249] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.825249] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.825566] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9563bd8-34ff-48e6-9804-3643714bb99a taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.825783] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9563bd8-34ff-48e6-9804-3643714bb99a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.825783] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9563bd8-34ff-48e6-9804-3643714bb99a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.826104] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9563bd8-34ff-48e6-9804-3643714bb99a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.826200] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9563bd8-34ff-48e6-9804-3643714bb99a',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.143600] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.143600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.143600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.143867] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.143867] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.144031] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.144121] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.144189] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.144337] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.144411] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.144496] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce is going to be updated. [ 1239.173043] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.173277] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.173277] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.173466] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.173604] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.182814] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: IN_PROGRESS for 2s [ 1239.328591] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.328757] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.329204] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9563bd8-34ff-48e6-9804-3643714bb99a with status ACTIVE [ 1239.329204] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.329337] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.329391] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.329586] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.329672] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.329873] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.329932] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.330028] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.330200] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.330322] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.330514] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.330640] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.330708] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.330871] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.330963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.331068] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9563bd8-34ff-48e6-9804-3643714bb99a is going to be updated. [ 1239.362310] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.362705] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.362800] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.363092] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.363314] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.363562] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9563bd8-34ff-48e6-9804-3643714bb99a" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.742073] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: SUCCESS [ 1240.742073] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.742073] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.742073] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.742586] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.742586] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.742586] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.742586] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.742754] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.742754] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.194264] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: SUCCESS [ 1241.194461] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce deletion is rescheduled due to dependency. [ 1241.194527] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.244463] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.747127] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.250681] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.250968] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.250968] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.251137] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.251232] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.251315] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 is going to be updated. [ 1242.299737] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.299963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.299963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.300191] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.300339] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.309616] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: IN_PROGRESS for 2s [ 1243.823993] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1243.824424] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1244.321914] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: SUCCESS [ 1244.322183] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.322380] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.322600] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.322815] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.322937] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.323021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.323168] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.323268] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.323361] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.323454] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.790318] env[65783]: INFO networking_nsxv3.common.synchronization [req-400f1708-8955-43bc-9efa-dc5bdc3b7b0e req-7690660b-aa75-476f-8667-fc8a2eb9484b tempest-AttachInterfacesTestJSON-1497773155 tempest-AttachInterfacesTestJSON-1497773155-project-member] Enqueued Resource ID: 04bf3900-0149-4c45-92b6-cfae98a48f4e with Priority: HIGHEST for action security_group_members [ 1244.790963] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04bf3900-0149-4c45-92b6-cfae98a48f4e with Priority: HIGHEST for action security_group_members [ 1244.791229] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-04bf3900-0149-4c45-92b6-cfae98a48f4e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.791352] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.791420] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.791610] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.791765] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.791863] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.791970] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.792077] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.792183] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.792275] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04bf3900-0149-4c45-92b6-cfae98a48f4e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.826458] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.826836] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.826836] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.827076] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.827321] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.827479] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.827577] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.827798] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.827921] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.828090] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.828281] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.828701] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.828701] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.828701] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.828913] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.829060] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.829178] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.829346] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.829458] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.829580] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.829706] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.294811] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.295024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.295145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.295295] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.295387] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.295580] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.295678] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.295758] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.295949] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.296035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.296126] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04bf3900-0149-4c45-92b6-cfae98a48f4e is going to be updated. [ 1245.322909] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.323140] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.323190] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.323413] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.323562] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.332289] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04bf3900-0149-4c45-92b6-cfae98a48f4e in Status: IN_PROGRESS for 2s [ 1245.332472] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b22e949b-61c8-4c23-9bc8-ab00e0ad5673: rpc.has_security_group_logging(os_id): False [ 1245.350063] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.350063] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.350063] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.350361] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.350361] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.350545] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.350644] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.350706] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.350888] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.350966] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.351178] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.351272] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.351333] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.351472] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.351546] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.351720] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.351859] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.351859] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.352014] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.352096] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.352188] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 is going to be updated. [ 1245.412714] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.412895] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.412966] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.413196] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.413597] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.433016] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: IN_PROGRESS for 2s [ 1247.342899] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04bf3900-0149-4c45-92b6-cfae98a48f4e in Status: SUCCESS [ 1247.343334] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04bf3900-0149-4c45-92b6-cfae98a48f4e deletion is rescheduled due to dependency. [ 1247.343334] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.452122] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: SUCCESS [ 1247.452351] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.332687] env[65783]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1248.332837] env[65783]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1249.219676] env[65783]: INFO networking_nsxv3.common.synchronization [None req-631253a3-8bb0-4e21-b9c5-1c69f10c6a86 tempest-AttachInterfacesTestJSON-1497773155 tempest-AttachInterfacesTestJSON-1497773155-project-member] Enqueued Resource ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 with Priority: HIGHEST for action security_group_rules [ 1249.220356] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 with Priority: HIGHEST for action security_group_rules [ 1249.220713] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.220849] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.220915] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.221188] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.221262] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.301521] env[65783]: INFO networking_nsxv3.common.synchronization [None req-4ca0f59d-ebd9-4c22-8578-8e9bc28e4d1d tempest-AttachInterfacesTestJSON-1497773155 tempest-AttachInterfacesTestJSON-1497773155-project-member] Enqueued Resource ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 with Priority: HIGHEST for action security_group_rules [ 1249.302036] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 with Priority: HIGHEST for action security_group_rules [ 1249.302350] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.302504] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.744052] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.744052] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.744052] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.744052] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.744052] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.744052] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 already deleted. [ 1249.744052] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.744052] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.744052] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.744052] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.264399] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.264937] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.264937] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.264937] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.264937] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.265153] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 already deleted. [ 1250.265153] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.617163] env[65783]: INFO networking_nsxv3.common.synchronization [req-12a6045e-ba26-4428-832b-8feab82c5a5d req-4f514f6a-65df-4922-8ba0-6098498df5a5 tempest-ServersTestJSON-581224055 tempest-ServersTestJSON-581224055-project-member] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1250.617417] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1250.617903] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.618033] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.618118] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.618289] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.618448] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.618548] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.618610] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.618756] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.618839] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.618931] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.122178] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.624953] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.127263] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.127490] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.127490] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.127638] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.127728] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.127826] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 is going to be updated. [ 1252.157986] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.158205] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.158282] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.158481] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.158619] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.167365] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: IN_PROGRESS for 2s [ 1254.179757] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: SUCCESS [ 1254.180404] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.719601] env[65783]: INFO networking_nsxv3.common.synchronization [req-ad0cfa5d-4e0b-4e0d-9f10-716ca50fb6a2 req-0568b95c-58c7-4c20-9c74-c96dc0ffb7f8 tempest-AttachInterfacesTestJSON-1497773155 tempest-AttachInterfacesTestJSON-1497773155-project-member] Enqueued Resource ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 with Priority: HIGHEST for action security_group_members [ 1254.719601] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 with Priority: HIGHEST for action security_group_members [ 1254.719601] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.719601] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.719601] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.719601] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.719601] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.719601] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.719601] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.719601] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.721027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.721175] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.997465] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.997764] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.997985] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.998340] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.998676] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.998918] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.999141] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.999422] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.999659] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.999936] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1255.000132] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1255.000323] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1255.000510] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1255.000700] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1255.000888] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1255.002022] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1255.021097] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1255.021335] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1255.021412] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1255.021548] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.021859] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-0c1d654b-57fe-46a4-a1f9-63029c094c97 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.022035] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-0c1d654b-57fe-46a4-a1f9-63029c094c97" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.022153] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-0c1d654b-57fe-46a4-a1f9-63029c094c97" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.022471] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-0c1d654b-57fe-46a4-a1f9-63029c094c97" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.022613] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c1d654b-57fe-46a4-a1f9-63029c094c97',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.223717] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.224258] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.224258] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.224459] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.224459] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.224647] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.224827] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.224974] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.225193] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.225285] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.225379] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 already deleted. [ 1255.225498] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.524994] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.525229] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.525359] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.525648] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.525817] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.525973] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 0c1d654b-57fe-46a4-a1f9-63029c094c97 not found, creating... [ 1255.526248] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.526404] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.526520] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.526736] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.526874] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.527167] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.527320] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.527436] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.527642] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.527776] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.527912] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 0c1d654b-57fe-46a4-a1f9-63029c094c97 is going to be created. [ 1255.547264] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.547469] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.547559] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.547804] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.548039] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.548262] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-0c1d654b-57fe-46a4-a1f9-63029c094c97" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.255123] env[65783]: INFO networking_nsxv3.common.synchronization [req-ad0cfa5d-4e0b-4e0d-9f10-716ca50fb6a2 req-5b7b6a57-b54d-465e-b0f3-329b674a0834 service nova] Enqueued Resource ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 with Priority: HIGHEST for action security_group_rules [ 1256.255484] env[65783]: INFO networking_nsxv3.common.synchronization [req-ad0cfa5d-4e0b-4e0d-9f10-716ca50fb6a2 req-5b7b6a57-b54d-465e-b0f3-329b674a0834 service nova] Enqueued Resource ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 with Priority: HIGHEST for action security_group_members [ 1256.255484] env[65783]: INFO networking_nsxv3.common.synchronization [req-ad0cfa5d-4e0b-4e0d-9f10-716ca50fb6a2 req-5b7b6a57-b54d-465e-b0f3-329b674a0834 service nova] Enqueued Resource ID: 0c1d654b-57fe-46a4-a1f9-63029c094c97 with Priority: HIGHEST for action port [ 1256.255991] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 with Priority: HIGHEST for action security_group_rules [ 1256.256151] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 with Priority: HIGHEST for action security_group_members [ 1256.256250] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c1d654b-57fe-46a4-a1f9-63029c094c97 with Priority: HIGHEST for action port [ 1256.256590] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.256716] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.256784] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.257030] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.257069] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.257957] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.258097] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.258163] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.258323] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.258469] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.258560] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.258620] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.258756] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.258915] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.258915] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.260145] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c1d654b-57fe-46a4-a1f9-63029c094c97 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.260145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c1d654b-57fe-46a4-a1f9-63029c094c97" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.260145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c1d654b-57fe-46a4-a1f9-63029c094c97" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.260145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c1d654b-57fe-46a4-a1f9-63029c094c97" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.260145] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c1d654b-57fe-46a4-a1f9-63029c094c97',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.762997] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.763132] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.763369] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.764574] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0c1d654b-57fe-46a4-a1f9-63029c094c97 with status ACTIVE [ 1256.764723] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.764903] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.764983] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.765553] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.765553] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.765553] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.765553] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.765941] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.765941] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.765941] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.766071] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.766150] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.766188] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.766337] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.766420] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.766503] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0c1d654b-57fe-46a4-a1f9-63029c094c97 is going to be updated. [ 1256.788418] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.788586] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.788635] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.789111] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.789248] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.789432] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c1d654b-57fe-46a4-a1f9-63029c094c97" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.269076] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.771275] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.771465] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.771533] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.771785] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.771888] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.772010] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 is going to be created. [ 1257.796804] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.797041] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.797041] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.797227] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.797380] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.808154] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 in Status: UNINITIALIZED for 2s [ 1259.821405] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 in Status: SUCCESS [ 1259.821405] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.821405] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.821405] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.821405] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.821405] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.821405] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.821405] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.821405] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.821405] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.821405] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.323256] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.825543] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656: rpc.has_security_group_logging(os_id): False [ 1260.846726] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.847055] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.847175] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.847505] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.847690] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.847999] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.848254] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.848305] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.848591] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.848764] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.848819] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 is going to be created. [ 1260.908385] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.908660] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.908718] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.909062] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.909299] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.921869] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 in Status: IN_PROGRESS for 2s [ 1261.257697] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1261.257844] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1262.936990] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 in Status: SUCCESS [ 1262.937446] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.412705] env[65783]: INFO networking_nsxv3.common.synchronization [req-0f3411af-c49e-4dcb-a9e6-7668e665b175 req-5121dfad-a986-4c0d-9f40-97cb77931c03 tempest-ServersTestJSON-581224055 tempest-ServersTestJSON-581224055-project-member] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1263.413337] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1263.413577] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.413693] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.413768] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.414171] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.414728] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.414925] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.415051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.415163] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.415249] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.415346] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.696500] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-334 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.696728] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-334" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.696929] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-334" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.697241] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-334" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.697480] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.697647] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.697795] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.698186] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.698370] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.698880] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1263.699021] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1263.699230] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1263.699378] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1263.699545] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1263.699619] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1263.699753] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1263.727332] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1263.727520] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1263.727660] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1263.727835] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-334" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.728189] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-d7eca264-2c75-44a4-a968-213e84c89d5b taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.728365] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-d7eca264-2c75-44a4-a968-213e84c89d5b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.728486] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-d7eca264-2c75-44a4-a968-213e84c89d5b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.728832] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-d7eca264-2c75-44a4-a968-213e84c89d5b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.729076] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7eca264-2c75-44a4-a968-213e84c89d5b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.917147] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.231685] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.232113] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.232163] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.232447] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.232666] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.232776] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port d7eca264-2c75-44a4-a968-213e84c89d5b not found, creating... [ 1264.233141] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.233310] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.233428] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.233664] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.233799] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.234110] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.234265] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.234381] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.234667] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.234838] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.235030] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: d7eca264-2c75-44a4-a968-213e84c89d5b is going to be created. [ 1264.255688] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.255931] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.256063] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.256382] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.256697] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.256929] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-d7eca264-2c75-44a4-a968-213e84c89d5b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.420009] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.922697] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.922953] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.923061] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.923339] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.923468] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.923599] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 is going to be updated. [ 1264.942786] env[65783]: INFO networking_nsxv3.common.synchronization [req-0f3411af-c49e-4dcb-a9e6-7668e665b175 req-475b627a-5a5b-40b7-be5d-7a947cae1d33 service nova] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_rules [ 1264.943131] env[65783]: INFO networking_nsxv3.common.synchronization [req-0f3411af-c49e-4dcb-a9e6-7668e665b175 req-475b627a-5a5b-40b7-be5d-7a947cae1d33 service nova] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1264.943327] env[65783]: INFO networking_nsxv3.common.synchronization [req-0f3411af-c49e-4dcb-a9e6-7668e665b175 req-475b627a-5a5b-40b7-be5d-7a947cae1d33 service nova] Enqueued Resource ID: d7eca264-2c75-44a4-a968-213e84c89d5b with Priority: HIGHEST for action port [ 1264.943986] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_rules [ 1264.944258] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1264.944450] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7eca264-2c75-44a4-a968-213e84c89d5b with Priority: HIGHEST for action port [ 1264.944926] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.945076] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.945170] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.948047] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.948047] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.948047] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.948047] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.948047] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7eca264-2c75-44a4-a968-213e84c89d5b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.948047] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7eca264-2c75-44a4-a968-213e84c89d5b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.948047] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7eca264-2c75-44a4-a968-213e84c89d5b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.948476] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7eca264-2c75-44a4-a968-213e84c89d5b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.948476] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7eca264-2c75-44a4-a968-213e84c89d5b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.955564] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.955875] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.955875] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.956235] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.956484] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.971447] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: IN_PROGRESS for 2s [ 1265.450227] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.450670] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.452707] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7eca264-2c75-44a4-a968-213e84c89d5b with status ACTIVE [ 1265.452919] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.453056] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.453129] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.453338] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.453418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.453591] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.453693] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.453754] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.453881] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.453936] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.454134] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.454217] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.454276] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.454427] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.454595] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.454655] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7eca264-2c75-44a4-a968-213e84c89d5b is going to be updated. [ 1265.478637] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.478831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.478831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.479059] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.479198] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.479346] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7eca264-2c75-44a4-a968-213e84c89d5b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.982094] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: SUCCESS [ 1266.982094] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.982558] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.982558] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.982635] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.982776] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.982820] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.982951] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.983051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.983147] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.485910] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.988343] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.281746] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.281934] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.281982] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.282234] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.282349] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.491206] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.491461] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.491461] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.491669] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.491755] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.491854] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 is going to be updated. [ 1268.526148] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.526304] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.526402] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.526629] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.526787] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.537811] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: IN_PROGRESS for 2s [ 1268.784484] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.287314] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.790049] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1269.790170] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1269.945503] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1269.945687] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1270.093033] env[65783]: INFO networking_nsxv3.common.synchronization [req-7358ed4e-3322-4de4-b437-848cb7b163cd req-0751e0a8-7437-4003-86d7-89a22994341f tempest-AttachInterfacesTestJSON-1497773155 tempest-AttachInterfacesTestJSON-1497773155-project-member] Enqueued Resource ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 with Priority: HIGHEST for action security_group_members [ 1270.098807] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 with Priority: HIGHEST for action security_group_members [ 1270.098807] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.098807] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.099034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.099034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.100014] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.100014] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.100014] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.100014] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.100014] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.100014] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.438128] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.438484] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.438484] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.438723] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.438975] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.439150] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.439265] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.439738] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.439738] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.439864] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1270.439916] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1270.440032] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1270.440147] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1270.440255] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1270.440360] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1270.440487] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1270.461766] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1270.461999] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1270.462196] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1270.462419] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.463066] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-b6e00388-271a-41b9-bb29-4463d4a692ea taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.463066] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-b6e00388-271a-41b9-bb29-4463d4a692ea" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.463206] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-b6e00388-271a-41b9-bb29-4463d4a692ea" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.463542] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-b6e00388-271a-41b9-bb29-4463d4a692ea" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.463689] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6e00388-271a-41b9-bb29-4463d4a692ea',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.557104] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: SUCCESS [ 1270.557322] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.557493] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.557709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.557910] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.558071] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.558153] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.558307] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.558397] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.558471] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.558579] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.601711] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.699038] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.699283] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.699283] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.699454] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.712899] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1270.713883] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.714808] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1270.767102] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.767102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.767102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.767367] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.780396] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.781616] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1270.781710] env[65783]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65783) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1270.781822] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1270.825192] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.825392] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.825392] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.825614] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.827152] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.827511] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1270.909807] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.910058] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.910109] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.910383] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.910740] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.911145] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1270.966404] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.966705] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.966827] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.967177] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.967339] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.967527] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port b6e00388-271a-41b9-bb29-4463d4a692ea not found, creating... [ 1270.967958] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.968252] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.968458] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.968871] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.969137] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.969574] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.969767] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.969887] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.970115] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.970259] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.970392] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: b6e00388-271a-41b9-bb29-4463d4a692ea is going to be created. [ 1270.990144] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.990427] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.990505] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.990791] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.991029] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.991276] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-b6e00388-271a-41b9-bb29-4463d4a692ea" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.994995] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.995173] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.995236] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.995398] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.995696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.995985] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:41. [ 1270.996239] env[65783]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'a938b55d-b711-4079-9f7b-f27235895480', '2efb684a-08ee-44d1-aaa1-abe589dfc483', '2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76', 'a56944ee-f571-421e-aac3-fe1ac51a1fd9', 'f2f8650e-b3af-426f-9fae-30baa4cb3e2c', '99e0c417-31bf-428f-9d83-2ec769f78d5e', '04bf3900-0149-4c45-92b6-cfae98a48f4e', '8c81f8cb-609b-4496-9f07-b80abbe519f8', '7dbaa62b-695c-43df-8e6f-4d18d6d47de5', '316d910a-b054-4723-942e-7f84e9154008', '6cc4f190-878a-48bb-a700-45297dd58d68', '8b9cb981-343d-4db5-9714-846a4e345d4b', 'eb5a0c7c-b375-4d79-8e33-962a90b59498', '5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40', 'ae30fa6b-a459-4159-9e85-a3e2921a0240', 'b22e949b-61c8-4c23-9bc8-ab00e0ad5673', 'acedd9dc-9634-46d8-93d5-54ad3add17a5', 'af1375c2-7b1e-420c-a8d1-1ccf5e01438b', '778e25c7-acbe-47ad-a052-4adb2729b152', '3672e01a-c2d7-4bab-8a43-04160e095ad1', 'ab77afc1-ca2d-4d03-8596-057f87dcdf4e', 'e588ff7c-d45a-4b75-823e-f219eeb5e814', '9b8bb0e6-1d22-4e95-a649-fc4d3180195b', 'bbaf974c-75cf-4b48-a666-f75dfe105a74', '7e223089-e294-4146-bace-319372e97362', '0010338f-67e3-417c-be88-4e0a85ad75aa', '74220b44-588c-49ac-81cc-e6ac2b7c6024', 'ca99b1a6-3702-4011-942b-06036fda2165', 'db3246d5-b700-4207-b606-2833b93da8c8', 'e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656', 'b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6', 'fdcea21f-f135-4ab1-9f28-d5be76c7c16b', 'c6dc57fb-f44d-4b26-87fe-bb8e4df202a8', 'b56f5230-554e-48f1-aef4-fcf2593b50d3', '21a0bbd4-6f51-4a42-b423-363e65f0247c', 'aaf15510-666a-49d9-9a20-6f398b7f8216', '527a6015-4311-4050-9945-7b4c6e602f59', '7998a549-f70e-4b58-992e-5c5ab6652711', '4a5d8777-50f6-4124-8014-838a921e8bd1', '044a26f5-b666-44c4-8c58-085d6cf0af26', 'e3bc25c3-f702-4fff-a8a0-27dd0dc43dce'} {{(pid=65783) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1270.996339] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1271.035653] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.035887] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.035887] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.036090] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.036164] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.036279] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1271.036354] env[65783]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65783) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1271.036412] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1271.061116] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.061442] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.061442] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.061742] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.062061] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.062172] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.062245] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.062398] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.062482] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.062569] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.062715] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.062802] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.062854] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.062995] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.063152] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.063240] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.063296] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.063429] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.063503] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.063580] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.063670] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.104163] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.169996] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.170257] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.170319] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.170576] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.171891] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.172239] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1271.172341] env[65783]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65783) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1271.172439] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1271.172544] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1271.172619] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/41 resources of Type:Security Group Rules [ 1271.172819] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a938b55d-b711-4079-9f7b-f27235895480 with Priority: HIGH for action security_group_rules [ 1271.172819] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2efb684a-08ee-44d1-aaa1-abe589dfc483 with Priority: HIGH for action security_group_rules [ 1271.172938] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGH for action security_group_rules [ 1271.173076] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGH for action security_group_rules [ 1271.173156] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f2f8650e-b3af-426f-9fae-30baa4cb3e2c with Priority: HIGH for action security_group_rules [ 1271.173207] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 99e0c417-31bf-428f-9d83-2ec769f78d5e with Priority: HIGH for action security_group_rules [ 1271.173327] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 04bf3900-0149-4c45-92b6-cfae98a48f4e with Priority: HIGH for action security_group_rules [ 1271.173477] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGH for action security_group_rules [ 1271.173477] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7dbaa62b-695c-43df-8e6f-4d18d6d47de5 with Priority: HIGH for action security_group_rules [ 1271.173553] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGH for action security_group_rules [ 1271.173583] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6cc4f190-878a-48bb-a700-45297dd58d68 with Priority: HIGH for action security_group_rules [ 1271.173635] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8b9cb981-343d-4db5-9714-846a4e345d4b with Priority: HIGH for action security_group_rules [ 1271.173779] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 with Priority: HIGH for action security_group_rules [ 1271.173779] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 with Priority: HIGH for action security_group_rules [ 1271.173902] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 with Priority: HIGH for action security_group_rules [ 1271.173902] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGH for action security_group_rules [ 1271.174014] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 with Priority: HIGH for action security_group_rules [ 1271.174014] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: af1375c2-7b1e-420c-a8d1-1ccf5e01438b with Priority: HIGH for action security_group_rules [ 1271.174241] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 778e25c7-acbe-47ad-a052-4adb2729b152 with Priority: HIGH for action security_group_rules [ 1271.174241] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3672e01a-c2d7-4bab-8a43-04160e095ad1 with Priority: HIGH for action security_group_rules [ 1271.174241] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.566788] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b22e949b-61c8-4c23-9bc8-ab00e0ad5673: rpc.has_security_group_logging(os_id): False [ 1271.585685] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.585853] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.586119] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.586395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.606751] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.606751] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.606988] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.607038] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.607112] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.607218] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 is going to be updated. [ 1271.610341] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.610463] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.610546] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.610598] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.610854] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.610854] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.611084] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.611165] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.611232] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.611376] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.611467] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.611622] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.611707] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.611781] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.611905] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.611971] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.612068] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 is going to be updated. [ 1271.636671] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.636811] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.636884] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.637117] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.637260] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.647199] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 in Status: IN_PROGRESS for 2s [ 1271.678602] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.678752] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.678824] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.679053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.679199] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.697189] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: IN_PROGRESS for 2s [ 1271.707111] env[65783]: INFO networking_nsxv3.common.synchronization [req-7358ed4e-3322-4de4-b437-848cb7b163cd req-096e6113-7f56-4293-8a70-f00d8dc12a28 service nova] Enqueued Resource ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 with Priority: HIGHEST for action security_group_rules [ 1271.707311] env[65783]: INFO networking_nsxv3.common.synchronization [req-7358ed4e-3322-4de4-b437-848cb7b163cd req-096e6113-7f56-4293-8a70-f00d8dc12a28 service nova] Enqueued Resource ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 with Priority: HIGHEST for action security_group_members [ 1271.707489] env[65783]: INFO networking_nsxv3.common.synchronization [req-7358ed4e-3322-4de4-b437-848cb7b163cd req-096e6113-7f56-4293-8a70-f00d8dc12a28 service nova] Enqueued Resource ID: b6e00388-271a-41b9-bb29-4463d4a692ea with Priority: HIGHEST for action port [ 1271.708595] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 with Priority: HIGHEST for action security_group_rules [ 1271.708752] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 with Priority: HIGHEST for action security_group_members [ 1271.708887] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e00388-271a-41b9-bb29-4463d4a692ea with Priority: HIGHEST for action port [ 1271.708947] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a938b55d-b711-4079-9f7b-f27235895480 with Priority: HIGH for action security_group_rules [ 1271.709043] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 with Priority: HIGH for action security_group_rules [ 1271.709136] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04bf3900-0149-4c45-92b6-cfae98a48f4e with Priority: HIGH for action security_group_rules [ 1271.709226] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 with Priority: HIGH for action security_group_rules [ 1271.709339] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3672e01a-c2d7-4bab-8a43-04160e095ad1 with Priority: HIGH for action security_group_rules [ 1271.709389] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 778e25c7-acbe-47ad-a052-4adb2729b152 with Priority: HIGH for action security_group_rules [ 1271.709470] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1375c2-7b1e-420c-a8d1-1ccf5e01438b with Priority: HIGH for action security_group_rules [ 1271.709555] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 with Priority: HIGH for action security_group_rules [ 1271.709640] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 with Priority: HIGH for action security_group_rules [ 1271.709723] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGH for action security_group_rules [ 1271.709806] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 with Priority: HIGH for action security_group_rules [ 1271.709889] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b9cb981-343d-4db5-9714-846a4e345d4b with Priority: HIGH for action security_group_rules [ 1271.709973] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cc4f190-878a-48bb-a700-45297dd58d68 with Priority: HIGH for action security_group_rules [ 1271.710067] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGH for action security_group_rules [ 1271.710150] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dbaa62b-695c-43df-8e6f-4d18d6d47de5 with Priority: HIGH for action security_group_rules [ 1271.710352] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99e0c417-31bf-428f-9d83-2ec769f78d5e with Priority: HIGH for action security_group_rules [ 1271.710352] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 with Priority: HIGH for action security_group_rules [ 1271.710535] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2f8650e-b3af-426f-9fae-30baa4cb3e2c with Priority: HIGH for action security_group_rules [ 1271.710535] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2efb684a-08ee-44d1-aaa1-abe589dfc483 with Priority: HIGH for action security_group_rules [ 1271.710535] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 with Priority: HIGH for action security_group_rules [ 1271.710827] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.710953] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.711027] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.711237] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.711321] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.712277] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.713067] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.713067] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6e00388-271a-41b9-bb29-4463d4a692ea taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.713067] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6e00388-271a-41b9-bb29-4463d4a692ea" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.713067] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6e00388-271a-41b9-bb29-4463d4a692ea" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.713067] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6e00388-271a-41b9-bb29-4463d4a692ea" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.713309] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6e00388-271a-41b9-bb29-4463d4a692ea',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.713982] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a938b55d-b711-4079-9f7b-f27235895480 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.714356] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.714356] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.714356] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.714471] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a938b55d-b711-4079-9f7b-f27235895480',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.715330] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.715489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.715489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.715657] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.715722] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.716748] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04bf3900-0149-4c45-92b6-cfae98a48f4e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.716748] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.716748] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.716748] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.716962] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04bf3900-0149-4c45-92b6-cfae98a48f4e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.718228] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae30fa6b-a459-4159-9e85-a3e2921a0240 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.718353] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.718401] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.718555] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.718627] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae30fa6b-a459-4159-9e85-a3e2921a0240',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.719771] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3672e01a-c2d7-4bab-8a43-04160e095ad1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.719883] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.719949] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.720226] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.720299] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3672e01a-c2d7-4bab-8a43-04160e095ad1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.721585] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-778e25c7-acbe-47ad-a052-4adb2729b152 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.721719] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.721775] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.721903] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.721999] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('778e25c7-acbe-47ad-a052-4adb2729b152',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.723105] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af1375c2-7b1e-420c-a8d1-1ccf5e01438b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.723105] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.723105] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.723323] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.723323] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af1375c2-7b1e-420c-a8d1-1ccf5e01438b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.724025] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-acedd9dc-9634-46d8-93d5-54ad3add17a5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.724564] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.724564] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.724686] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.724751] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('acedd9dc-9634-46d8-93d5-54ad3add17a5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.726045] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.726045] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.726045] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.726045] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.726045] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.726929] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.727357] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.727582] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb5a0c7c-b375-4d79-8e33-962a90b59498 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.727685] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.727769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.727941] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.728039] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb5a0c7c-b375-4d79-8e33-962a90b59498',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.729303] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b9cb981-343d-4db5-9714-846a4e345d4b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.729445] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.729492] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.729815] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.729815] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b9cb981-343d-4db5-9714-846a4e345d4b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.730787] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6cc4f190-878a-48bb-a700-45297dd58d68 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.731010] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.731090] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.731430] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.731430] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6cc4f190-878a-48bb-a700-45297dd58d68',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.732435] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-316d910a-b054-4723-942e-7f84e9154008 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.732573] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.732644] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.732802] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.732893] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.733806] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dbaa62b-695c-43df-8e6f-4d18d6d47de5 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.733925] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.733993] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.734165] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.734242] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dbaa62b-695c-43df-8e6f-4d18d6d47de5',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.735234] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99e0c417-31bf-428f-9d83-2ec769f78d5e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.735351] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.735418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.735569] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.735647] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99e0c417-31bf-428f-9d83-2ec769f78d5e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.736467] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c81f8cb-609b-4496-9f07-b80abbe519f8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.736581] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.736646] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.736791] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.736862] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c81f8cb-609b-4496-9f07-b80abbe519f8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.740062] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2f8650e-b3af-426f-9fae-30baa4cb3e2c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.740062] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.740062] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.740199] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.740254] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2f8650e-b3af-426f-9fae-30baa4cb3e2c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.741105] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2efb684a-08ee-44d1-aaa1-abe589dfc483 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.741457] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.741555] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.741732] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.742017] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2efb684a-08ee-44d1-aaa1-abe589dfc483',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.743300] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.743542] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.743653] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.743920] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.743994] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a56944ee-f571-421e-aac3-fe1ac51a1fd9',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.770059] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.770218] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.770277] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.770843] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.797517] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.797736] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76 is going to be deleted. [ 1271.871031] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.871186] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.871186] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.871373] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.871460] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.871569] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b8b0512-3bc7-4f6f-bba1-0a44fdbf5f76" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.230347] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb5a0c7c-b375-4d79-8e33-962a90b59498 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.230578] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.230578] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.230761] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.230925] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.231082] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.231170] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.231329] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.231422] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.231498] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.231586] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb5a0c7c-b375-4d79-8e33-962a90b59498',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.245944] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.246239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.246239] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.246458] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.250376] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b6e00388-271a-41b9-bb29-4463d4a692ea with status ACTIVE [ 1272.250604] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.250681] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.250742] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.250933] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.251029] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.251486] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.251486] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.251486] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.251486] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.251731] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.251731] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.251833] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.251871] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.252011] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.252088] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.252171] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b6e00388-271a-41b9-bb29-4463d4a692ea is going to be updated. [ 1272.258214] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.258384] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.264523] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.264707] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.269148] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.269347] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.273091] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-316d910a-b054-4723-942e-7f84e9154008 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.273267] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.273316] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.273501] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.273675] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.273780] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.273844] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.274024] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.274174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.274231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.274297] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.343483] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.343483] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.349078] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.349078] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.349361] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.349361] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.350049] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.350174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.350997] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.351126] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae30fa6b-a459-4159-9e85-a3e2921a0240 is going to be deleted. [ 1272.352020] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.352223] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.355811] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.355991] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.356928] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.357039] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.368616] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.368818] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.369255] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.369447] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.377339] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.377591] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.378353] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.378452] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.379111] env[65783]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1272.379525] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.379618] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.380210] env[65783]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1272.380624] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.380716] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.381317] env[65783]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1272.381712] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.381819] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.390257] env[65783]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1272.390789] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.391088] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.391209] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.391503] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.391652] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.391864] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6e00388-271a-41b9-bb29-4463d4a692ea" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.392660] env[65783]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1272.393130] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.393282] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04bf3900-0149-4c45-92b6-cfae98a48f4e is going to be deleted. [ 1272.394273] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.394519] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.416999] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.417235] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3672e01a-c2d7-4bab-8a43-04160e095ad1 is going to be deleted. [ 1272.418196] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.418461] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.427958] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.428374] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.442375] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.442576] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99e0c417-31bf-428f-9d83-2ec769f78d5e is going to be deleted. [ 1272.443477] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.443697] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.458590] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.458895] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.493506] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.493719] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b9cb981-343d-4db5-9714-846a4e345d4b is going to be deleted. [ 1272.494749] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.495097] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.546897] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.547184] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.549355] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.549478] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2efb684a-08ee-44d1-aaa1-abe589dfc483 is going to be deleted. [ 1272.550468] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.550702] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.584616] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.585087] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.609863] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.610065] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a938b55d-b711-4079-9f7b-f27235895480 is going to be deleted. [ 1272.611568] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.611916] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.682265] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.682489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.702680] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.702930] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a56944ee-f571-421e-aac3-fe1ac51a1fd9 is going to be deleted. [ 1272.704443] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.704802] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.733503] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb5a0c7c-b375-4d79-8e33-962a90b59498',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.766135] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.766325] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c81f8cb-609b-4496-9f07-b80abbe519f8 is going to be deleted. [ 1272.767382] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.767641] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.778216] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.783376] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.783376] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.801646] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.801814] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.811223] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.811395] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af1375c2-7b1e-420c-a8d1-1ccf5e01438b is going to be deleted. [ 1272.812362] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.812599] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.859627] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.859827] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6cc4f190-878a-48bb-a700-45297dd58d68 is going to be deleted. [ 1272.860980] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.861279] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.905284] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.905439] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: acedd9dc-9634-46d8-93d5-54ad3add17a5 is going to be deleted. [ 1272.906464] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.906685] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.913323] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.913510] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.974304] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.974428] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.990880] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.991488] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.004372] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.008240] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2f8650e-b3af-426f-9fae-30baa4cb3e2c is going to be deleted. [ 1273.008240] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.008240] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.043647] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.043647] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dbaa62b-695c-43df-8e6f-4d18d6d47de5 is going to be deleted. [ 1273.043647] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.043647] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.045408] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.045408] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.235549] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb5a0c7c-b375-4d79-8e33-962a90b59498: rpc.has_security_group_logging(os_id): False [ 1273.280656] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 316d910a-b054-4723-942e-7f84e9154008: rpc.has_security_group_logging(os_id): False [ 1273.390322] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.390548] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.391234] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.391387] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.396351] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.396524] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.415954] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.416275] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.418915] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.419090] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.429827] env[65783]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1273.430460] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.430585] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 778e25c7-acbe-47ad-a052-4adb2729b152 is going to be deleted. [ 1273.431660] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.431889] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.495811] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.496167] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40 is going to be deleted. [ 1273.497636] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.497901] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.498034] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.498126] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae30fa6b-a459-4159-9e85-a3e2921a0240" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.498262] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.498435] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.498506] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.498635] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04bf3900-0149-4c45-92b6-cfae98a48f4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.499191] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.499384] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.499475] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.499531] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3672e01a-c2d7-4bab-8a43-04160e095ad1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.499665] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.499808] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.499881] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.500030] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99e0c417-31bf-428f-9d83-2ec769f78d5e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.500170] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.500306] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.500379] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.500535] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b9cb981-343d-4db5-9714-846a4e345d4b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.500611] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.500750] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.500820] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.500926] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2efb684a-08ee-44d1-aaa1-abe589dfc483" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.501064] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.501207] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.501278] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.501388] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a938b55d-b711-4079-9f7b-f27235895480" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.501579] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.501641] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.501703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.501814] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a56944ee-f571-421e-aac3-fe1ac51a1fd9" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.501935] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.502086] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.502161] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.502350] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af1375c2-7b1e-420c-a8d1-1ccf5e01438b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.502445] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.502599] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.502680] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.502785] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6cc4f190-878a-48bb-a700-45297dd58d68" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.503011] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.503173] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.503246] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.503361] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c81f8cb-609b-4496-9f07-b80abbe519f8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.503485] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.503621] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.503695] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.503802] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-acedd9dc-9634-46d8-93d5-54ad3add17a5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.503926] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.504086] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.504168] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.504299] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2f8650e-b3af-426f-9fae-30baa4cb3e2c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.504409] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.504553] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.587161] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.587692] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.587692] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.587861] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.588069] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.588069] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.588250] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 316d910a-b054-4723-942e-7f84e9154008 is going to be updated. [ 1273.589610] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.589809] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.589904] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.590017] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dbaa62b-695c-43df-8e6f-4d18d6d47de5" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.590175] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.590329] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.613119] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.613388] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.711391] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.711664] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.712496] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.712772] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.713108] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.713223] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.713482] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.713573] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.713678] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 is going to be updated. [ 1273.714806] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.715174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.715307] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.715435] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-778e25c7-acbe-47ad-a052-4adb2729b152" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.715611] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.715787] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.715891] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.716116] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d5a02a3-de62-47f0-85c4-2c5c8c7e0c40" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.717086] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 in Status: SUCCESS [ 1273.717344] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.717953] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.718170] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.718426] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.718571] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.718648] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.718832] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.718948] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.719225] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.786256] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: SUCCESS [ 1273.786575] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.786777] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.787073] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.787149] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.907751] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.907887] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.907964] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.908234] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.908380] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.914199] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.914384] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.914436] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.914634] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.914784] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.932260] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 316d910a-b054-4723-942e-7f84e9154008 in Status: IN_PROGRESS for 2s [ 1273.940114] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 in Status: IN_PROGRESS for 2s [ 1274.222983] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.289824] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.290069] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.290216] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.290567] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.290738] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.290822] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.290942] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.291188] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.291269] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.291463] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.291463] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.725170] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.793798] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.794040] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.794135] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.794423] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.794627] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.794760] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.794836] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.795116] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.795231] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.795295] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.795452] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.795551] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.795615] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.795758] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.795901] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.796062] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.796158] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.796255] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.796330] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.796412] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.796505] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.228111] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.228346] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.228415] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.228585] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.228684] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.228780] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 is going to be updated. [ 1275.260568] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.260568] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.260568] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.260568] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.260568] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.269050] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 in Status: IN_PROGRESS for 2s [ 1275.298498] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b22e949b-61c8-4c23-9bc8-ab00e0ad5673: rpc.has_security_group_logging(os_id): False [ 1275.318200] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.318358] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.318407] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.318621] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.318709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.319750] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.319750] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.319750] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.319750] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.319750] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.319750] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.319750] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.319750] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.319750] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.320176] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.320176] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.320176] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.320176] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.320329] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.320329] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.320397] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 is going to be updated. [ 1275.402670] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.402823] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.402893] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.403123] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.404068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.426470] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: IN_PROGRESS for 2s [ 1275.571079] env[65783]: INFO networking_nsxv3.common.synchronization [req-dd77db91-d9ae-4613-81f3-8a32c7eca660 req-aa7dcc54-c628-451c-9bdb-16122b28970b tempest-AttachVolumeNegativeTest-1814624860 tempest-AttachVolumeNegativeTest-1814624860-project-member] Enqueued Resource ID: db3246d5-b700-4207-b606-2833b93da8c8 with Priority: HIGHEST for action security_group_members [ 1275.571611] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db3246d5-b700-4207-b606-2833b93da8c8 with Priority: HIGHEST for action security_group_members [ 1275.571977] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-db3246d5-b700-4207-b606-2833b93da8c8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.572164] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.572264] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.572781] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.572781] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.573643] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.573643] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.573643] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.573643] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.573643] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db3246d5-b700-4207-b606-2833b93da8c8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.949089] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 316d910a-b054-4723-942e-7f84e9154008 in Status: SUCCESS [ 1275.949089] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.960736] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 in Status: SUCCESS [ 1275.960974] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.076116] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.076380] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.076380] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.076554] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.101292] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.101607] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.101747] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.101835] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.102056] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.102142] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.102254] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db3246d5-b700-4207-b606-2833b93da8c8 is going to be updated. [ 1276.133298] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.133536] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.133536] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.133767] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.133911] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.146349] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db3246d5-b700-4207-b606-2833b93da8c8 in Status: IN_PROGRESS for 2s [ 1277.280093] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 in Status: SUCCESS [ 1277.280093] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.280093] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.280727] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.280727] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.280727] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.280877] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.281152] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.281290] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.281471] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.281640] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.444568] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: SUCCESS [ 1277.444838] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.784692] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.107614] env[65783]: INFO networking_nsxv3.common.synchronization [req-2bb91d66-1284-48a3-8fb3-080a49bd4888 req-ae4b3649-3ecb-4269-9351-738d2d01dd26 tempest-AttachVolumeShelveTestJSON-903356803 tempest-AttachVolumeShelveTestJSON-903356803-project-member] Enqueued Resource ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 with Priority: HIGHEST for action security_group_members [ 1278.109146] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 with Priority: HIGHEST for action security_group_members [ 1278.109146] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb5a0c7c-b375-4d79-8e33-962a90b59498 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.109146] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.109146] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.109146] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.109146] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.109146] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.109448] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.109448] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.109591] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.109649] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb5a0c7c-b375-4d79-8e33-962a90b59498',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.159741] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db3246d5-b700-4207-b606-2833b93da8c8 in Status: SUCCESS [ 1278.159922] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db3246d5-b700-4207-b606-2833b93da8c8 deletion is rescheduled due to dependency. [ 1278.160043] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.289511] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656: rpc.has_security_group_logging(os_id): False [ 1278.306400] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.306562] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.306562] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.306757] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.328309] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.328608] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.328728] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.328791] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.328999] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.329096] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.329198] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 is going to be updated. [ 1278.392060] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.392204] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.392270] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.393087] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.393258] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.410227] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 in Status: IN_PROGRESS for 2s [ 1278.612859] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.613102] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.613153] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.613334] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.613483] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.613694] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.613795] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.613859] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.614023] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.614100] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.614186] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 is going to be updated. [ 1278.642928] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.643186] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.643256] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.643466] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.643603] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.652790] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 in Status: IN_PROGRESS for 2s [ 1280.239087] env[65783]: INFO networking_nsxv3.common.synchronization [req-ad33ab64-076e-47db-9270-ab4d3302128a req-8e6387b9-0723-4fa6-bc7d-84602fcf096e tempest-ServersTestJSON-581224055 tempest-ServersTestJSON-581224055-project-member] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1280.239447] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1280.239908] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.239908] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.239908] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.240157] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.240317] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.240416] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.240470] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.240620] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.240699] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.240789] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.425934] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 in Status: SUCCESS [ 1280.426251] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.662245] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 in Status: SUCCESS [ 1280.662417] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 deletion is rescheduled due to dependency. [ 1280.662536] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.743190] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.245064] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.747410] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.747567] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.747635] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.747859] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.747945] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.748106] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 is going to be updated. [ 1281.776348] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.776561] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.776561] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.776785] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.776930] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.786289] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: IN_PROGRESS for 2s [ 1281.962193] env[65783]: INFO networking_nsxv3.common.synchronization [None req-69116cb4-307a-4bdb-a0d4-aec5e7e02599 tempest-AttachInterfacesTestJSON-1497773155 tempest-AttachInterfacesTestJSON-1497773155-project-member] Enqueued Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_members [ 1281.962490] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_members [ 1281.963152] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.963281] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.963351] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.963544] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.963694] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.963793] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.963904] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.964012] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.964121] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.964168] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.466148] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.466583] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.466583] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.466696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.489835] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.490265] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.490503] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.490590] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.490897] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.491051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.491196] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce is going to be updated. [ 1282.519449] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.519637] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.519685] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.519868] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.520016] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.534333] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: IN_PROGRESS for 2s [ 1283.797622] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: SUCCESS [ 1283.797968] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.544392] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: SUCCESS [ 1284.544573] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce deletion is rescheduled due to dependency. [ 1284.544624] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.619068] env[65783]: INFO networking_nsxv3.common.synchronization [req-d5e226d1-1ca1-4289-8b33-9bca613d3c2f req-af17a28d-6d15-4e28-91c7-964cfd4814c4 tempest-ServersTestJSON-581224055 tempest-ServersTestJSON-581224055-project-member] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1286.619068] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGHEST for action security_group_members [ 1286.619068] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.619947] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.620156] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.621581] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.621946] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.622286] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.622463] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.622739] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.622946] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.623178] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.125097] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.125275] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.125348] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.125561] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.125650] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.125848] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.125946] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.126076] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.126196] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.126276] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.126363] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 is going to be updated. [ 1287.154222] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.154382] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.154382] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.154550] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.154691] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.163583] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: IN_PROGRESS for 2s [ 1289.177044] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 in Status: SUCCESS [ 1289.177415] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 deletion is rescheduled due to dependency. [ 1289.177415] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.620203] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1291.620203] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1296.621453] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1296.621453] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1298.564825] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.564825] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.564825] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.565337] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.565337] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.565497] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.565613] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.565833] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.565971] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.566192] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1298.566308] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1298.566414] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1298.566521] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1298.566627] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1298.566730] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1298.566854] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1298.587450] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1298.587607] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1298.587744] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1298.587908] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.588235] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-e0ea25a5-c2ed-405d-b6bf-bc16e70fd558 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.588403] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-e0ea25a5-c2ed-405d-b6bf-bc16e70fd558" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.588522] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-e0ea25a5-c2ed-405d-b6bf-bc16e70fd558" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.588852] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-e0ea25a5-c2ed-405d-b6bf-bc16e70fd558" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.588993] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0ea25a5-c2ed-405d-b6bf-bc16e70fd558',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.091944] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.092339] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.092577] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.093093] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.093343] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.093608] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port e0ea25a5-c2ed-405d-b6bf-bc16e70fd558 not found, creating... [ 1299.094061] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.094329] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.094562] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.094921] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.095196] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.095656] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.095992] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.096175] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.096494] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.096738] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.096990] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: e0ea25a5-c2ed-405d-b6bf-bc16e70fd558 is going to be created. [ 1299.118059] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.118326] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.118465] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.118735] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.118959] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.119224] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-e0ea25a5-c2ed-405d-b6bf-bc16e70fd558" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.790241] env[65783]: INFO networking_nsxv3.common.synchronization [req-c358ad06-b378-46a7-84ec-cd3aa08bb743 req-81a94591-57e7-47d9-9ed2-2c53a94e3179 service nova] Enqueued Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_rules [ 1299.790479] env[65783]: INFO networking_nsxv3.common.synchronization [req-c358ad06-b378-46a7-84ec-cd3aa08bb743 req-81a94591-57e7-47d9-9ed2-2c53a94e3179 service nova] Enqueued Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_members [ 1299.790528] env[65783]: INFO networking_nsxv3.common.synchronization [req-c358ad06-b378-46a7-84ec-cd3aa08bb743 req-81a94591-57e7-47d9-9ed2-2c53a94e3179 service nova] Enqueued Resource ID: e0ea25a5-c2ed-405d-b6bf-bc16e70fd558 with Priority: HIGHEST for action port [ 1299.790758] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_rules [ 1299.790891] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_members [ 1299.790986] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0ea25a5-c2ed-405d-b6bf-bc16e70fd558 with Priority: HIGHEST for action port [ 1299.791550] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.791722] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.791761] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.791925] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.792010] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.794909] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.795014] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.795014] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.795207] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.795355] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.795711] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.795711] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.795711] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.795891] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.795891] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.796690] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0ea25a5-c2ed-405d-b6bf-bc16e70fd558 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.796809] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0ea25a5-c2ed-405d-b6bf-bc16e70fd558" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.796809] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0ea25a5-c2ed-405d-b6bf-bc16e70fd558" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.797143] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0ea25a5-c2ed-405d-b6bf-bc16e70fd558" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.797143] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0ea25a5-c2ed-405d-b6bf-bc16e70fd558',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.298629] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.298753] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.298944] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.299851] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0ea25a5-c2ed-405d-b6bf-bc16e70fd558 with status ACTIVE [ 1300.300042] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.300158] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.300215] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.300410] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.300493] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.300658] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.300760] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.300820] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.300964] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.301049] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.301230] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.301320] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.301382] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.301504] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.301630] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.301671] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0ea25a5-c2ed-405d-b6bf-bc16e70fd558 is going to be updated. [ 1300.323707] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.323930] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.323930] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.324132] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.324268] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.324418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0ea25a5-c2ed-405d-b6bf-bc16e70fd558" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.803460] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.306511] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.306721] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.306721] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.306892] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.306976] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.307104] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce is going to be updated. [ 1301.334860] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.335085] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.335145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.335350] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.335491] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.343542] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: IN_PROGRESS for 2s [ 1303.355079] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: SUCCESS [ 1303.355079] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.355079] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.355079] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.355990] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.355990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.355990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.355990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.355990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.355990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.355990] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.858760] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.859092] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.859092] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.859220] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.859386] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.859491] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.859554] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.859704] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.859790] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.859876] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.860029] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.860123] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.860184] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.860323] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.860464] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.860553] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.860609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.860745] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.860817] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.860895] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.860983] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.363585] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e3bc25c3-f702-4fff-a8a0-27dd0dc43dce: rpc.has_security_group_logging(os_id): False [ 1304.381741] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.381942] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.381942] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.382186] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.382280] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.382507] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.382606] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.382955] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.382955] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.382955] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.383134] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.383134] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.383237] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.383371] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.383476] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.383617] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.383709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.383769] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.383906] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.383979] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.384072] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce is going to be updated. [ 1304.445162] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.445391] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.445391] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.445534] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.445676] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.458105] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: IN_PROGRESS for 2s [ 1304.791923] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1304.792130] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1306.472754] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: SUCCESS [ 1306.473118] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.760959] env[65783]: INFO networking_nsxv3.common.synchronization [req-6756794c-a844-4cc6-a400-152ba6e96d61 req-eac7598e-d7a7-4d4a-a4d6-770c196ece3d tempest-ServerActionsTestJSON-316964864 tempest-ServerActionsTestJSON-316964864-project-member] Enqueued Resource ID: ab77afc1-ca2d-4d03-8596-057f87dcdf4e with Priority: HIGHEST for action security_group_members [ 1308.761751] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab77afc1-ca2d-4d03-8596-057f87dcdf4e with Priority: HIGHEST for action security_group_members [ 1308.762092] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab77afc1-ca2d-4d03-8596-057f87dcdf4e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.762215] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.762380] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.762481] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.762624] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.762723] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.762783] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.762909] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.762990] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.763112] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab77afc1-ca2d-4d03-8596-057f87dcdf4e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.265591] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.265828] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.265828] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.266021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.289100] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.289290] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.289469] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.289469] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.289680] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.289765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.289856] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab77afc1-ca2d-4d03-8596-057f87dcdf4e is going to be updated. [ 1309.318291] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.318435] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.318477] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.318685] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.318820] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.327749] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab77afc1-ca2d-4d03-8596-057f87dcdf4e in Status: IN_PROGRESS for 2s [ 1311.344123] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab77afc1-ca2d-4d03-8596-057f87dcdf4e in Status: SUCCESS [ 1311.344345] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab77afc1-ca2d-4d03-8596-057f87dcdf4e deletion is rescheduled due to dependency. [ 1311.344546] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.763113] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1313.763872] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1315.627873] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.628220] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.628220] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.628500] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.628761] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.628919] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.629046] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.629314] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.629479] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.629692] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1315.629810] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1315.629922] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1315.630045] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1315.630161] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1315.630271] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1315.630435] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1315.651426] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1315.651599] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1315.651790] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1315.651971] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-988" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.652307] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-e0ea25a5-c2ed-405d-b6bf-bc16e70fd558 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.652485] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-e0ea25a5-c2ed-405d-b6bf-bc16e70fd558" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.652610] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-e0ea25a5-c2ed-405d-b6bf-bc16e70fd558" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.652876] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-e0ea25a5-c2ed-405d-b6bf-bc16e70fd558" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.653031] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0ea25a5-c2ed-405d-b6bf-bc16e70fd558',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.155945] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.156234] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.156401] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.156686] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.156842] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.157130] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.157306] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.157464] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.157709] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.157848] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.158152] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.158313] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.158430] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.158634] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.158766] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.158905] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: e0ea25a5-c2ed-405d-b6bf-bc16e70fd558 is going to be updated. [ 1316.180062] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.180276] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.180398] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.180972] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.181194] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.181420] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-e0ea25a5-c2ed-405d-b6bf-bc16e70fd558" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.853340] env[65783]: INFO networking_nsxv3.common.synchronization [req-25875925-d2b7-49e0-a163-70f72fb0c304 req-a3773841-cb45-4cf5-bb1f-18adb4f3c87c service nova] Enqueued Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_rules [ 1316.853340] env[65783]: INFO networking_nsxv3.common.synchronization [req-25875925-d2b7-49e0-a163-70f72fb0c304 req-a3773841-cb45-4cf5-bb1f-18adb4f3c87c service nova] Enqueued Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_members [ 1316.853340] env[65783]: INFO networking_nsxv3.common.synchronization [req-25875925-d2b7-49e0-a163-70f72fb0c304 req-a3773841-cb45-4cf5-bb1f-18adb4f3c87c service nova] Enqueued Resource ID: e0ea25a5-c2ed-405d-b6bf-bc16e70fd558 with Priority: HIGHEST for action port [ 1316.853340] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_rules [ 1316.853340] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_members [ 1316.853340] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0ea25a5-c2ed-405d-b6bf-bc16e70fd558 with Priority: HIGHEST for action port [ 1316.853340] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.854014] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.854267] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.854555] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.854732] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.855785] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.856021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.856196] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.856483] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.856735] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.856940] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.857116] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.857379] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.858046] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.858046] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.858618] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0ea25a5-c2ed-405d-b6bf-bc16e70fd558 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.859084] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0ea25a5-c2ed-405d-b6bf-bc16e70fd558" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.859915] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0ea25a5-c2ed-405d-b6bf-bc16e70fd558" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.859915] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0ea25a5-c2ed-405d-b6bf-bc16e70fd558" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.859915] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0ea25a5-c2ed-405d-b6bf-bc16e70fd558',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.361825] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.361997] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.362179] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.363102] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0ea25a5-c2ed-405d-b6bf-bc16e70fd558 with status ACTIVE [ 1317.363307] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.363724] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.363724] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.363850] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.363850] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.364013] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.364112] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.364174] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.364521] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.364587] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.364812] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.364909] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.364972] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.365170] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.365206] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.365339] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0ea25a5-c2ed-405d-b6bf-bc16e70fd558 is going to be updated. [ 1317.384933] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.385130] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.385177] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.385413] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.385545] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.385700] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0ea25a5-c2ed-405d-b6bf-bc16e70fd558" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.866888] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.369509] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.369860] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.369860] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.369970] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.370072] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.370170] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce is going to be updated. [ 1318.399078] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.399331] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.399331] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.399491] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.399631] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.407773] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: IN_PROGRESS for 2s [ 1320.426832] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: SUCCESS [ 1320.427284] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.427427] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.427611] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.427836] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.427961] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.428060] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.428241] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.428313] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.428435] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.428572] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.931498] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.931680] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.931765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.931963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.932197] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.932318] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.932421] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.932599] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.932686] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.932963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.932963] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.933101] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.933101] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.933418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.933418] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.933586] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.933586] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.933714] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.933789] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.933869] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.934031] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.436118] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e3bc25c3-f702-4fff-a8a0-27dd0dc43dce: rpc.has_security_group_logging(os_id): False [ 1321.454856] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.455099] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.455099] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.455323] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.455418] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.455703] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.455855] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.455855] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.456032] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.456106] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.456298] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.456398] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.456459] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.456601] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.456667] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.456847] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.456939] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.456994] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.457137] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.457208] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.457292] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce is going to be updated. [ 1321.520022] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.520243] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.520243] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.520446] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.520551] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.536752] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: IN_PROGRESS for 2s [ 1321.853514] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1321.853703] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1323.556158] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: SUCCESS [ 1323.556498] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.854501] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1326.854880] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1331.855519] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1331.855992] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1333.447199] env[65783]: INFO networking_nsxv3.common.synchronization [req-bdc9ae5d-5ee8-4663-a78c-03d52a68521e req-71be948b-c4ee-48b4-ad25-a152ebc763d4 tempest-AttachInterfacesTestJSON-1497773155 tempest-AttachInterfacesTestJSON-1497773155-project-member] Enqueued Resource ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 with Priority: HIGHEST for action security_group_members [ 1333.447943] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 with Priority: HIGHEST for action security_group_members [ 1333.448411] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.449302] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.449393] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.449601] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.449784] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.449914] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.449980] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.450152] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.450237] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.450328] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.955319] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.457318] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.960305] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.960481] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.960523] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.960742] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.960831] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.960964] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 is going to be updated. [ 1334.989762] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.989978] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.989978] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.990147] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.990289] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.999037] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 in Status: IN_PROGRESS for 2s [ 1337.012285] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 in Status: SUCCESS [ 1337.012661] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.448841] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1338.449256] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1339.992454] env[65783]: INFO networking_nsxv3.common.synchronization [req-4d09802d-5705-4c43-a25f-9f1170a2ffcc req-4f43f317-bfe4-4ca5-aa75-2872b2a445bb tempest-AttachInterfacesTestJSON-1497773155 tempest-AttachInterfacesTestJSON-1497773155-project-member] Enqueued Resource ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 with Priority: HIGHEST for action security_group_members [ 1339.992454] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 with Priority: HIGHEST for action security_group_members [ 1339.992697] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.992800] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.992835] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.993149] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.993343] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.993485] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.993577] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.993768] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.993876] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.993987] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.496398] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.496654] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.496654] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.496880] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.496973] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.497197] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.497297] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.497358] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.497506] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.497591] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.497716] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 is going to be updated. [ 1340.526331] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.526551] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.526551] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.526762] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.526904] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.535840] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 in Status: IN_PROGRESS for 2s [ 1342.546790] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 in Status: SUCCESS [ 1342.547270] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 deletion is rescheduled due to dependency. [ 1342.547270] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.670506] env[65783]: INFO networking_nsxv3.common.synchronization [req-414e1739-f570-44f2-a62f-85f80e37772f req-799fe286-dfa9-4b8b-b71b-4b1af46d2845 tempest-ServerActionsTestJSON-316964864 tempest-ServerActionsTestJSON-316964864-project-member] Enqueued Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGHEST for action security_group_members [ 1342.670506] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGHEST for action security_group_members [ 1342.670807] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-316d910a-b054-4723-942e-7f84e9154008 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.670984] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.671401] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.671484] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.671601] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.671709] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.671780] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.671916] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.671995] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.672102] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.174379] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.174576] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.174629] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.174837] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.174930] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.175144] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.175241] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.175301] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.175532] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.175697] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.175802] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 316d910a-b054-4723-942e-7f84e9154008 is going to be updated. [ 1343.203638] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.203851] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.203898] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.204084] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.204223] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.214070] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 316d910a-b054-4723-942e-7f84e9154008 in Status: IN_PROGRESS for 2s [ 1344.378837] env[65783]: INFO networking_nsxv3.common.synchronization [None req-1b796fa6-b3ca-49b7-8fd0-4b8ed80f0b68 tempest-AttachInterfacesTestJSON-1497773155 tempest-AttachInterfacesTestJSON-1497773155-project-member] Enqueued Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_members [ 1344.380284] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce with Priority: HIGHEST for action security_group_members [ 1344.380284] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.380284] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.380284] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.380284] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.380284] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.380701] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.380701] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.380701] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.380701] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.380829] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3bc25c3-f702-4fff-a8a0-27dd0dc43dce',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.882890] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.883094] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.883094] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.883227] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.883318] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.883516] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.883693] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.883765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.883944] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.884035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.884124] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce is going to be updated. [ 1344.911744] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.911947] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.911947] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.912158] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.912299] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.920473] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: IN_PROGRESS for 2s [ 1345.224289] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 316d910a-b054-4723-942e-7f84e9154008 in Status: IN_PROGRESS for 4s [ 1346.930571] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce in Status: SUCCESS [ 1346.930859] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3bc25c3-f702-4fff-a8a0-27dd0dc43dce deletion is rescheduled due to dependency. [ 1346.930859] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3bc25c3-f702-4fff-a8a0-27dd0dc43dce" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.234980] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 316d910a-b054-4723-942e-7f84e9154008 in Status: SUCCESS [ 1347.235190] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 316d910a-b054-4723-942e-7f84e9154008 deletion is rescheduled due to dependency. [ 1347.235407] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.380888] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1349.380888] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1350.343061] env[65783]: INFO networking_nsxv3.common.synchronization [req-1be42c9f-7d9f-475f-a665-3aa9982e73c3 req-f959fd88-0ccb-4da6-8eec-d7d9cfae8d45 tempest-ServerActionsTestJSON-316964864 tempest-ServerActionsTestJSON-316964864-project-member] Enqueued Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGHEST for action security_group_members [ 1350.344461] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGHEST for action security_group_members [ 1350.344461] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-316d910a-b054-4723-942e-7f84e9154008 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.344461] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.344461] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.344765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.345726] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.345726] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.345726] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.345726] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.345726] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.345726] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.604039] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.604039] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "network-11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.604039] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "network-11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.604490] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "network-11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.604490] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.604589] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.604719] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.604853] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.604996] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.605222] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1350.605333] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1350.605436] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1350.605564] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1350.605682] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1350.605786] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1350.605911] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1350.627862] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1350.628133] env[65783]: DEBUG dogpile.cache.region [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1350.628214] env[65783]: DEBUG dogpile.lock [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1350.628662] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "network-11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.628736] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock port-70f44b4b-cbc4-4d9a-bc86-ab4a45508ef0 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.628862] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "port-70f44b4b-cbc4-4d9a-bc86-ab4a45508ef0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.628964] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "port-70f44b4b-cbc4-4d9a-bc86-ab4a45508ef0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.629322] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "port-70f44b4b-cbc4-4d9a-bc86-ab4a45508ef0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.629462] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70f44b4b-cbc4-4d9a-bc86-ab4a45508ef0',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.847683] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.847930] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.847930] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.848148] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.848242] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.848448] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.848554] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.848619] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.848773] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.848852] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.848943] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 316d910a-b054-4723-942e-7f84e9154008 is going to be updated. [ 1350.876106] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.876338] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.876338] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.876524] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.876703] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.886123] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 316d910a-b054-4723-942e-7f84e9154008 in Status: IN_PROGRESS for 2s [ 1351.132236] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.132415] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.132528] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.132812] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.132956] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.133125] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Segment Port 70f44b4b-cbc4-4d9a-bc86-ab4a45508ef0 not found, creating... [ 1351.133412] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.133584] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.133708] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.133918] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.134069] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.134349] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.134502] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.134618] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.134820] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.134947] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.135095] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Resource: SegmentPort with ID: 70f44b4b-cbc4-4d9a-bc86-ab4a45508ef0 is going to be created. [ 1351.156758] env[65783]: DEBUG networking_nsxv3.common.locking [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.156973] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.157034] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.157306] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.157523] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.157741] env[65783]: DEBUG oslo_concurrency.lockutils [None req-d27ff79d-4b30-4ed2-aa71-035c8ef19ecf None None] Releasing lock "port-70f44b4b-cbc4-4d9a-bc86-ab4a45508ef0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.870799] env[65783]: INFO networking_nsxv3.common.synchronization [req-1be42c9f-7d9f-475f-a665-3aa9982e73c3 req-0795006f-1be8-4da4-b33c-30dc0378d650 service nova] Enqueued Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGHEST for action security_group_rules [ 1351.871063] env[65783]: INFO networking_nsxv3.common.synchronization [req-1be42c9f-7d9f-475f-a665-3aa9982e73c3 req-0795006f-1be8-4da4-b33c-30dc0378d650 service nova] Enqueued Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGHEST for action security_group_members [ 1351.871109] env[65783]: INFO networking_nsxv3.common.synchronization [req-1be42c9f-7d9f-475f-a665-3aa9982e73c3 req-0795006f-1be8-4da4-b33c-30dc0378d650 service nova] Enqueued Resource ID: 70f44b4b-cbc4-4d9a-bc86-ab4a45508ef0 with Priority: HIGHEST for action port [ 1351.871345] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGHEST for action security_group_rules [ 1351.871432] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGHEST for action security_group_members [ 1351.871541] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70f44b4b-cbc4-4d9a-bc86-ab4a45508ef0 with Priority: HIGHEST for action port [ 1351.872162] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-316d910a-b054-4723-942e-7f84e9154008 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.872315] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.872372] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.872564] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.872643] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.874011] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-316d910a-b054-4723-942e-7f84e9154008 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.874011] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.874011] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-70f44b4b-cbc4-4d9a-bc86-ab4a45508ef0 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.874011] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70f44b4b-cbc4-4d9a-bc86-ab4a45508ef0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.874011] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70f44b4b-cbc4-4d9a-bc86-ab4a45508ef0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.874341] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70f44b4b-cbc4-4d9a-bc86-ab4a45508ef0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.874341] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70f44b4b-cbc4-4d9a-bc86-ab4a45508ef0',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.376216] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-316d910a-b054-4723-942e-7f84e9154008 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.376457] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.376558] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70f44b4b-cbc4-4d9a-bc86-ab4a45508ef0 with status ACTIVE [ 1352.376716] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.376825] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.376885] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.377114] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.377203] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.377371] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.377463] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.377524] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.377659] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.377733] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.377921] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.378053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.378130] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.378252] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.378287] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.378357] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70f44b4b-cbc4-4d9a-bc86-ab4a45508ef0 is going to be updated. [ 1352.399022] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.399234] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.399234] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.399401] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.399567] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.399676] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70f44b4b-cbc4-4d9a-bc86-ab4a45508ef0" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.896750] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 316d910a-b054-4723-942e-7f84e9154008 in Status: SUCCESS [ 1352.897249] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 316d910a-b054-4723-942e-7f84e9154008 deletion is rescheduled due to dependency. [ 1352.897249] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.897249] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.897436] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.897582] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.897705] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.897785] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.897922] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.897999] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.898086] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.400931] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.904084] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.409053] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.409053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.409053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.409053] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.409430] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.409430] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 316d910a-b054-4723-942e-7f84e9154008 is going to be updated. [ 1354.439705] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.439862] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.439922] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.440155] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.440299] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.448797] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 316d910a-b054-4723-942e-7f84e9154008 in Status: IN_PROGRESS for 2s [ 1356.462117] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 316d910a-b054-4723-942e-7f84e9154008 in Status: SUCCESS [ 1356.462117] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.462518] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.462518] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.462680] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.462846] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.462930] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.463157] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.463270] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.463382] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.463499] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.872426] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1356.872619] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1356.965322] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.467276] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 316d910a-b054-4723-942e-7f84e9154008: rpc.has_security_group_logging(os_id): False [ 1357.484700] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.484912] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.484912] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.485143] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.485236] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.485490] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.485628] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.485696] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.485850] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.485925] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.486020] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 316d910a-b054-4723-942e-7f84e9154008 is going to be updated. [ 1357.543241] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.543458] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.543458] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.543640] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.543789] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.556311] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 316d910a-b054-4723-942e-7f84e9154008 in Status: IN_PROGRESS for 2s [ 1359.572966] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 316d910a-b054-4723-942e-7f84e9154008 in Status: SUCCESS [ 1359.573376] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.874116] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1361.874497] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1366.875300] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1366.875300] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1371.876780] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1371.877213] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1376.877569] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1376.877569] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1381.878375] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1381.878760] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1386.879501] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1386.879947] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1391.880432] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1391.880857] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1396.881355] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1396.881674] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1401.883055] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1401.883496] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1406.885311] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1406.885693] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1411.886381] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1411.886746] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1416.887683] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1416.887683] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1421.888572] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1421.888572] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1426.890705] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1426.890705] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1431.427637] env[65783]: INFO networking_nsxv3.common.synchronization [req-4a8c6e9e-2fd8-4325-9c17-3089702b7d5b req-78e2657e-b525-4b9f-b735-9f73773f5dbe tempest-ServerActionsTestJSON-316964864 tempest-ServerActionsTestJSON-316964864-project-member] Enqueued Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGHEST for action security_group_members [ 1431.428175] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGHEST for action security_group_members [ 1431.428671] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-316d910a-b054-4723-942e-7f84e9154008 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.428671] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.428671] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.428833] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.428980] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.429091] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.429153] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.429318] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.429400] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.429502] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1431.931758] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.931998] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.931998] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.932261] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.932261] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.932473] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.932582] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.932644] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.932796] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.932871] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.932956] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 316d910a-b054-4723-942e-7f84e9154008 is going to be updated. [ 1431.971764] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.972016] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.972016] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.972179] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.972320] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.981405] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 316d910a-b054-4723-942e-7f84e9154008 in Status: IN_PROGRESS for 2s [ 1433.995336] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 316d910a-b054-4723-942e-7f84e9154008 in Status: SUCCESS [ 1433.995828] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 316d910a-b054-4723-942e-7f84e9154008 deletion is rescheduled due to dependency. [ 1433.995828] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.429306] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1436.429306] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1438.459708] env[65783]: INFO networking_nsxv3.common.synchronization [req-31bb9192-1d00-4d07-843a-9225a0f3f043 req-cab87db0-8f48-4b8c-8766-31fb860e7f52 tempest-ServerActionsTestJSON-316964864 tempest-ServerActionsTestJSON-316964864-project-member] Enqueued Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGHEST for action security_group_members [ 1438.460341] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGHEST for action security_group_members [ 1438.460781] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-316d910a-b054-4723-942e-7f84e9154008 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.460924] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.460995] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.461372] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.461537] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.461658] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.461723] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.461881] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.461966] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.462075] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1438.732982] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.733205] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "network-11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.733330] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "network-11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.733600] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "network-11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.734247] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.734418] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.734540] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.734759] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.734904] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.735125] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1438.735245] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] NeedRegenerationException {{(pid=65783) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1438.735355] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] no value, waiting for create lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1438.735466] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] value creation lock acquired {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1438.735577] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] No value present for key: 'zone-id' {{(pid=65783) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1438.735684] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Calling creation function for not-yet-present value {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1438.735812] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1438.755606] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1438.755764] env[65783]: DEBUG dogpile.cache.region [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65783) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1438.755903] env[65783]: DEBUG dogpile.lock [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Released creation lock {{(pid=65783) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1438.756084] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "network-11" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.756419] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock port-bab8becc-f8fa-4a74-abbd-677bfd2508f1 taken with stack trace [, , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.756592] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "port-bab8becc-f8fa-4a74-abbd-677bfd2508f1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.756712] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "port-bab8becc-f8fa-4a74-abbd-677bfd2508f1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.757032] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "port-bab8becc-f8fa-4a74-abbd-677bfd2508f1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.757221] env[65783]: DEBUG networking_nsxv3.api.rpc [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bab8becc-f8fa-4a74-abbd-677bfd2508f1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1438.964213] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.964458] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.964458] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.964673] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.964761] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.964958] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.965070] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.965133] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.965281] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.965381] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.965513] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 316d910a-b054-4723-942e-7f84e9154008 is going to be updated. [ 1438.993958] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.994176] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.994280] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.994491] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.994637] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.009664] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 316d910a-b054-4723-942e-7f84e9154008 in Status: IN_PROGRESS for 2s [ 1439.259865] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.260143] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.260334] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.260791] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.260997] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.261212] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Segment Port bab8becc-f8fa-4a74-abbd-677bfd2508f1 not found, creating... [ 1439.261511] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.261700] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.261797] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.262051] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.262191] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.262515] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.262686] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.262786] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.263043] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.263234] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.263406] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Resource: SegmentPort with ID: bab8becc-f8fa-4a74-abbd-677bfd2508f1 is going to be created. [ 1439.286603] env[65783]: DEBUG networking_nsxv3.common.locking [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.286916] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.286916] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.287277] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.287516] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.287748] env[65783]: DEBUG oslo_concurrency.lockutils [None req-3ee9e14a-b2fd-4936-8246-b7dc2afaf3c2 None None] Releasing lock "port-bab8becc-f8fa-4a74-abbd-677bfd2508f1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.982933] env[65783]: INFO networking_nsxv3.common.synchronization [req-31bb9192-1d00-4d07-843a-9225a0f3f043 req-721f953e-4545-4a93-bac4-ec860947cb4f service nova] Enqueued Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGHEST for action security_group_rules [ 1439.983236] env[65783]: INFO networking_nsxv3.common.synchronization [req-31bb9192-1d00-4d07-843a-9225a0f3f043 req-721f953e-4545-4a93-bac4-ec860947cb4f service nova] Enqueued Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGHEST for action security_group_members [ 1439.983335] env[65783]: INFO networking_nsxv3.common.synchronization [req-31bb9192-1d00-4d07-843a-9225a0f3f043 req-721f953e-4545-4a93-bac4-ec860947cb4f service nova] Enqueued Resource ID: bab8becc-f8fa-4a74-abbd-677bfd2508f1 with Priority: HIGHEST for action port [ 1439.983513] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGHEST for action security_group_rules [ 1439.983644] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGHEST for action security_group_members [ 1439.983735] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bab8becc-f8fa-4a74-abbd-677bfd2508f1 with Priority: HIGHEST for action port [ 1439.984315] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-316d910a-b054-4723-942e-7f84e9154008 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.984439] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.984506] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.984704] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.985115] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1439.985932] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-316d910a-b054-4723-942e-7f84e9154008 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.986041] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.986611] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock port-bab8becc-f8fa-4a74-abbd-677bfd2508f1 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.986728] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bab8becc-f8fa-4a74-abbd-677bfd2508f1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.986778] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bab8becc-f8fa-4a74-abbd-677bfd2508f1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.986950] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bab8becc-f8fa-4a74-abbd-677bfd2508f1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.987247] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bab8becc-f8fa-4a74-abbd-677bfd2508f1',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1440.488917] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-316d910a-b054-4723-942e-7f84e9154008 taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.489165] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.489219] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bab8becc-f8fa-4a74-abbd-677bfd2508f1 with status ACTIVE [ 1440.489363] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.489471] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.489578] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.489770] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.489861] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.490083] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.490175] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.490220] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.490404] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.490495] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.490679] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.490774] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.490835] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.490976] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.491062] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.491159] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bab8becc-f8fa-4a74-abbd-677bfd2508f1 is going to be updated. [ 1440.514331] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.514542] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.514542] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.514707] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.514837] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.514989] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bab8becc-f8fa-4a74-abbd-677bfd2508f1" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.020244] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 316d910a-b054-4723-942e-7f84e9154008 in Status: SUCCESS [ 1441.020601] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 316d910a-b054-4723-942e-7f84e9154008 deletion is rescheduled due to dependency. [ 1441.020659] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.020814] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.021035] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.021221] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.021346] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.021411] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.021570] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.021647] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.021742] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1441.523964] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1442.026476] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1442.529560] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.529747] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.529796] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.530021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.530113] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.530213] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 316d910a-b054-4723-942e-7f84e9154008 is going to be updated. [ 1442.560265] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.560380] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.560471] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.560730] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.561234] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.570492] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 316d910a-b054-4723-942e-7f84e9154008 in Status: IN_PROGRESS for 2s [ 1444.582334] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 316d910a-b054-4723-942e-7f84e9154008 in Status: SUCCESS [ 1444.582744] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.582744] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.582891] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.583085] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.583205] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.583267] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.583422] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.583499] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.583581] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.583672] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1444.984775] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1444.984994] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1445.085732] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1445.588281] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 316d910a-b054-4723-942e-7f84e9154008: rpc.has_security_group_logging(os_id): False [ 1445.607674] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.607902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.607902] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.608131] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.608213] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.608467] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.608572] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.608630] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.608776] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.608853] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.608963] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 316d910a-b054-4723-942e-7f84e9154008 is going to be updated. [ 1445.703826] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.704021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.705064] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.705064] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.705064] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.719473] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 316d910a-b054-4723-942e-7f84e9154008 in Status: IN_PROGRESS for 2s [ 1447.734122] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 316d910a-b054-4723-942e-7f84e9154008 in Status: SUCCESS [ 1447.734617] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.986591] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1449.986979] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1454.988335] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1454.988706] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1459.989567] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1459.989567] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1464.991064] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1464.991508] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1469.992506] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1469.992994] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1474.993804] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1474.994248] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1479.994890] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1479.995330] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1484.996155] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1484.996594] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1488.334017] env[65783]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1488.334462] env[65783]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-a5596b24-4764-444a-b5b4-62ad4faacb12 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1489.997316] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1489.997810] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1494.998469] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1494.998900] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1500.000106] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1500.000579] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1501.208793] env[65783]: INFO networking_nsxv3.common.synchronization [req-c62ea071-af96-40e2-a09c-ba9e1a1f6f3d req-d380b40e-968e-4a8f-a1a9-cfb6c06e27c5 tempest-ServerActionsTestJSON-316964864 tempest-ServerActionsTestJSON-316964864-project-member] Enqueued Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGHEST for action security_group_members [ 1501.209349] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGHEST for action security_group_members [ 1501.209683] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock member-316d910a-b054-4723-942e-7f84e9154008 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.209815] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.209879] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.210083] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.210233] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.210328] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.211135] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.211135] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.211135] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.211135] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1501.712523] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.712736] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.712736] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.712969] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.713124] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.713348] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.713474] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.713539] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.713737] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.713863] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.713973] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 316d910a-b054-4723-942e-7f84e9154008 is going to be updated. [ 1501.750315] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.750549] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.750603] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.750787] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.750932] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.759710] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 316d910a-b054-4723-942e-7f84e9154008 in Status: IN_PROGRESS for 2s [ 1503.770220] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 316d910a-b054-4723-942e-7f84e9154008 in Status: SUCCESS [ 1503.770580] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 316d910a-b054-4723-942e-7f84e9154008 deletion is rescheduled due to dependency. [ 1503.770580] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.210896] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1506.211272] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1508.285500] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.285792] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.285944] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.286258] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.286382] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.788728] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1509.291337] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1509.793392] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1509.793659] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1510.570734] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.571161] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.571161] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.571161] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.583536] env[65783]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1510.586092] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.586861] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1510.758193] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.758488] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.758488] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.758679] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.771565] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.772390] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1510.772471] env[65783]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65783) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1510.772559] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1510.801456] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.801652] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.801652] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.801861] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.802563] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.802723] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1510.875034] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.875213] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.875282] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.875494] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.875795] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.876098] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1510.952399] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.952548] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.952619] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.952832] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.953145] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.953425] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:24. [ 1510.953535] env[65783]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'b22e949b-61c8-4c23-9bc8-ab00e0ad5673', 'ab77afc1-ca2d-4d03-8596-057f87dcdf4e', 'bbaf974c-75cf-4b48-a666-f75dfe105a74', 'e588ff7c-d45a-4b75-823e-f219eeb5e814', '9b8bb0e6-1d22-4e95-a649-fc4d3180195b', '7e223089-e294-4146-bace-319372e97362', '0010338f-67e3-417c-be88-4e0a85ad75aa', '316d910a-b054-4723-942e-7f84e9154008', '74220b44-588c-49ac-81cc-e6ac2b7c6024', 'ca99b1a6-3702-4011-942b-06036fda2165', 'eb5a0c7c-b375-4d79-8e33-962a90b59498', 'db3246d5-b700-4207-b606-2833b93da8c8', 'e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656', 'b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6', 'fdcea21f-f135-4ab1-9f28-d5be76c7c16b', 'c6dc57fb-f44d-4b26-87fe-bb8e4df202a8', 'b56f5230-554e-48f1-aef4-fcf2593b50d3', '21a0bbd4-6f51-4a42-b423-363e65f0247c', 'aaf15510-666a-49d9-9a20-6f398b7f8216', '527a6015-4311-4050-9945-7b4c6e602f59', '7998a549-f70e-4b58-992e-5c5ab6652711', '4a5d8777-50f6-4124-8014-838a921e8bd1', '044a26f5-b666-44c4-8c58-085d6cf0af26', 'e3bc25c3-f702-4fff-a8a0-27dd0dc43dce'} {{(pid=65783) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1510.953622] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1510.973185] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.973380] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.973380] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.973585] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.973671] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.973783] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1510.973854] env[65783]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65783) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1510.973924] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1511.042927] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.043169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.043169] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.043352] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.044448] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.044768] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1511.044883] env[65783]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65783) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1511.045017] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1511.045085] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1511.045191] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/24 resources of Type:Security Group Rules [ 1511.045290] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGH for action security_group_rules [ 1511.045398] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ab77afc1-ca2d-4d03-8596-057f87dcdf4e with Priority: HIGH for action security_group_rules [ 1511.045494] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bbaf974c-75cf-4b48-a666-f75dfe105a74 with Priority: HIGH for action security_group_rules [ 1511.045585] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 with Priority: HIGH for action security_group_rules [ 1511.045674] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9b8bb0e6-1d22-4e95-a649-fc4d3180195b with Priority: HIGH for action security_group_rules [ 1511.045773] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7e223089-e294-4146-bace-319372e97362 with Priority: HIGH for action security_group_rules [ 1511.045871] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0010338f-67e3-417c-be88-4e0a85ad75aa with Priority: HIGH for action security_group_rules [ 1511.045967] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGH for action security_group_rules [ 1511.046068] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 with Priority: HIGH for action security_group_rules [ 1511.046161] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGH for action security_group_rules [ 1511.046249] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 with Priority: HIGH for action security_group_rules [ 1511.046331] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: db3246d5-b700-4207-b606-2833b93da8c8 with Priority: HIGH for action security_group_rules [ 1511.046410] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 with Priority: HIGH for action security_group_rules [ 1511.046493] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGH for action security_group_rules [ 1511.046585] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b with Priority: HIGH for action security_group_rules [ 1511.046682] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 with Priority: HIGH for action security_group_rules [ 1511.046760] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b56f5230-554e-48f1-aef4-fcf2593b50d3 with Priority: HIGH for action security_group_rules [ 1511.046825] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 21a0bbd4-6f51-4a42-b423-363e65f0247c with Priority: HIGH for action security_group_rules [ 1511.046885] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aaf15510-666a-49d9-9a20-6f398b7f8216 with Priority: HIGH for action security_group_rules [ 1511.046946] env[65783]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 527a6015-4311-4050-9945-7b4c6e602f59 with Priority: HIGH for action security_group_rules [ 1511.047057] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.211827] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1511.212038] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1511.212090] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 with Priority: HIGH for action security_group_rules [ 1511.212290] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbaf974c-75cf-4b48-a666-f75dfe105a74 with Priority: HIGH for action security_group_rules [ 1511.212413] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0010338f-67e3-417c-be88-4e0a85ad75aa with Priority: HIGH for action security_group_rules [ 1511.212512] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b with Priority: HIGH for action security_group_rules [ 1511.212607] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527a6015-4311-4050-9945-7b4c6e602f59 with Priority: HIGH for action security_group_rules [ 1511.212744] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaf15510-666a-49d9-9a20-6f398b7f8216 with Priority: HIGH for action security_group_rules [ 1511.212889] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21a0bbd4-6f51-4a42-b423-363e65f0247c with Priority: HIGH for action security_group_rules [ 1511.212988] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b56f5230-554e-48f1-aef4-fcf2593b50d3 with Priority: HIGH for action security_group_rules [ 1511.213097] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 with Priority: HIGH for action security_group_rules [ 1511.213185] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 with Priority: HIGH for action security_group_rules [ 1511.213271] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 with Priority: HIGH for action security_group_rules [ 1511.213356] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db3246d5-b700-4207-b606-2833b93da8c8 with Priority: HIGH for action security_group_rules [ 1511.213464] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 with Priority: HIGH for action security_group_rules [ 1511.213634] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca99b1a6-3702-4011-942b-06036fda2165 with Priority: HIGH for action security_group_rules [ 1511.213803] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 with Priority: HIGH for action security_group_rules [ 1511.213971] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e223089-e294-4146-bace-319372e97362 with Priority: HIGH for action security_group_rules [ 1511.214124] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 316d910a-b054-4723-942e-7f84e9154008 with Priority: HIGH for action security_group_rules [ 1511.214234] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b8bb0e6-1d22-4e95-a649-fc4d3180195b with Priority: HIGH for action security_group_rules [ 1511.214330] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab77afc1-ca2d-4d03-8596-057f87dcdf4e with Priority: HIGH for action security_group_rules [ 1511.214486] env[65783]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 with Priority: HIGH for action security_group_rules [ 1511.214846] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.215021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.215095] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.215322] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.215407] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b22e949b-61c8-4c23-9bc8-ab00e0ad5673',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.216408] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbaf974c-75cf-4b48-a666-f75dfe105a74 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.216523] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.216589] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.216788] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.216865] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbaf974c-75cf-4b48-a666-f75dfe105a74',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.217997] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0010338f-67e3-417c-be88-4e0a85ad75aa taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.218117] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.218182] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.218333] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.218602] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0010338f-67e3-417c-be88-4e0a85ad75aa',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.219174] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdcea21f-f135-4ab1-9f28-d5be76c7c16b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.219302] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.219302] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.219913] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.219913] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdcea21f-f135-4ab1-9f28-d5be76c7c16b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.220222] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-527a6015-4311-4050-9945-7b4c6e602f59 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.220325] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.220389] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.220533] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.220603] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('527a6015-4311-4050-9945-7b4c6e602f59',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.221373] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aaf15510-666a-49d9-9a20-6f398b7f8216 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.221466] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.221534] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.221681] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.221752] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aaf15510-666a-49d9-9a20-6f398b7f8216',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.222419] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21a0bbd4-6f51-4a42-b423-363e65f0247c taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.222543] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.222586] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.222719] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.222788] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21a0bbd4-6f51-4a42-b423-363e65f0247c',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.223452] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b56f5230-554e-48f1-aef4-fcf2593b50d3 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.223556] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.223765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.223765] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.223928] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b56f5230-554e-48f1-aef4-fcf2593b50d3',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.224589] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.224693] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.224744] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.224889] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.224960] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.225609] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.225710] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.225910] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.225996] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.226068] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6dc57fb-f44d-4b26-87fe-bb8e4df202a8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.226810] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.226810] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.226956] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.227021] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.227105] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.227799] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db3246d5-b700-4207-b606-2833b93da8c8 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.227907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.227907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.228069] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.228166] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db3246d5-b700-4207-b606-2833b93da8c8',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.228896] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb5a0c7c-b375-4d79-8e33-962a90b59498 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.229022] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.229082] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.229225] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.229292] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb5a0c7c-b375-4d79-8e33-962a90b59498',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.229940] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca99b1a6-3702-4011-942b-06036fda2165 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.230057] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.230124] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.230610] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.230610] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca99b1a6-3702-4011-942b-06036fda2165',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.230965] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74220b44-588c-49ac-81cc-e6ac2b7c6024 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.231179] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.231179] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.231304] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.231359] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74220b44-588c-49ac-81cc-e6ac2b7c6024',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.232072] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e223089-e294-4146-bace-319372e97362 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.232176] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.232255] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.232391] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.232455] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e223089-e294-4146-bace-319372e97362',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.233117] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-316d910a-b054-4723-942e-7f84e9154008 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.233222] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.233284] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.233488] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.233488] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('316d910a-b054-4723-942e-7f84e9154008',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.234148] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b8bb0e6-1d22-4e95-a649-fc4d3180195b taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.234260] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b8bb0e6-1d22-4e95-a649-fc4d3180195b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.234315] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b8bb0e6-1d22-4e95-a649-fc4d3180195b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.234454] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b8bb0e6-1d22-4e95-a649-fc4d3180195b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.234524] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b8bb0e6-1d22-4e95-a649-fc4d3180195b',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.235264] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab77afc1-ca2d-4d03-8596-057f87dcdf4e taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.235361] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.235427] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.235569] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.235666] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab77afc1-ca2d-4d03-8596-057f87dcdf4e',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.236327] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e588ff7c-d45a-4b75-823e-f219eeb5e814 taken with stack trace [, , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.236392] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.236435] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.236591] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.236667] env[65783]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e588ff7c-d45a-4b75-823e-f219eeb5e814',) {} {{(pid=65783) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.272121] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.272340] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.272340] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.272468] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.280893] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.281070] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.282102] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.282196] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.283014] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.283114] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.283795] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.283889] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.284568] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.284673] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.285363] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.285454] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.288757] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.288865] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdcea21f-f135-4ab1-9f28-d5be76c7c16b is going to be deleted. [ 1511.289681] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.289886] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.308246] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.308390] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aaf15510-666a-49d9-9a20-6f398b7f8216 is going to be deleted. [ 1511.309459] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.309661] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.329892] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.330053] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b22e949b-61c8-4c23-9bc8-ab00e0ad5673 is going to be deleted. [ 1511.330875] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.331107] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.350790] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.350942] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0010338f-67e3-417c-be88-4e0a85ad75aa is going to be deleted. [ 1511.351772] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.351985] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.353325] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.353438] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.368749] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.368947] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.372637] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.372779] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b56f5230-554e-48f1-aef4-fcf2593b50d3 is going to be deleted. [ 1511.373614] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.373824] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.376703] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.376857] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.420515] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.420702] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 527a6015-4311-4050-9945-7b4c6e602f59 is going to be deleted. [ 1511.421598] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.421823] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.467878] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.468075] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbaf974c-75cf-4b48-a666-f75dfe105a74 is going to be deleted. [ 1511.468912] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.469142] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.469232] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.469354] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdcea21f-f135-4ab1-9f28-d5be76c7c16b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.469507] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.469657] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.469812] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.469853] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aaf15510-666a-49d9-9a20-6f398b7f8216" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.470325] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.470489] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.470554] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.470654] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b22e949b-61c8-4c23-9bc8-ab00e0ad5673" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.493858] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.494128] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.494128] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.494292] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.494395] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.494499] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0010338f-67e3-417c-be88-4e0a85ad75aa" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.501386] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.501609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.501609] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.501780] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.501868] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.501989] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b56f5230-554e-48f1-aef4-fcf2593b50d3" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.564069] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.564069] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.564069] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.564069] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.564069] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.564069] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-527a6015-4311-4050-9945-7b4c6e602f59" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.621552] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.621983] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.621983] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.621983] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.622123] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.622171] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbaf974c-75cf-4b48-a666-f75dfe105a74" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.780684] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.780938] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.780938] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.781142] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.782774] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.782930] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.783578] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.783676] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.784328] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.784426] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.785075] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.785170] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.785905] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.785999] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.787412] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.787499] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.788204] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.788301] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.788980] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.789076] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.789735] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.789830] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.799834] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.799951] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.802397] env[65783]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1511.802832] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.802925] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.803578] env[65783]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1511.803952] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.804051] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.806121] env[65783]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1511.806513] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.806643] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e223089-e294-4146-bace-319372e97362 is going to be deleted. [ 1511.807621] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.807844] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.832376] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.832562] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74220b44-588c-49ac-81cc-e6ac2b7c6024 is going to be deleted. [ 1511.833438] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.833653] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.862648] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.862836] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca99b1a6-3702-4011-942b-06036fda2165 is going to be deleted. [ 1511.863818] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.864068] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.881173] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.881382] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.888083] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.888219] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db3246d5-b700-4207-b606-2833b93da8c8 is going to be deleted. [ 1511.889184] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.889431] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.890932] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.891045] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.912025] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.912189] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21a0bbd4-6f51-4a42-b423-363e65f0247c is going to be deleted. [ 1511.913082] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.913298] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.933971] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.934198] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.935724] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.935861] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656 is going to be deleted. [ 1511.936813] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.937045] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.001647] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.001848] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.005446] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.005568] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab77afc1-ca2d-4d03-8596-057f87dcdf4e is going to be deleted. [ 1512.006464] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.006711] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.027317] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.027442] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.091580] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.091737] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb5a0c7c-b375-4d79-8e33-962a90b59498 is going to be deleted. [ 1512.092691] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.092907] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.117382] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.117598] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.159656] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.159871] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b8bb0e6-1d22-4e95-a649-fc4d3180195b is going to be deleted. [ 1512.160753] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.160974] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.186786] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.186971] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6 is going to be deleted. [ 1512.187884] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.188150] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.209062] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.209278] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.222606] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.222818] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6dc57fb-f44d-4b26-87fe-bb8e4df202a8 is going to be deleted. [ 1512.223949] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.224201] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.282096] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.282247] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 316d910a-b054-4723-942e-7f84e9154008 is going to be deleted. [ 1512.283180] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.283398] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.315520] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.315749] env[65783]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e588ff7c-d45a-4b75-823e-f219eeb5e814 is going to be deleted. [ 1512.316637] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.316879] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.316966] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.317103] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e223089-e294-4146-bace-319372e97362" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.317260] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.317415] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.317492] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.317596] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74220b44-588c-49ac-81cc-e6ac2b7c6024" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.318134] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.318288] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.318380] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.318474] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca99b1a6-3702-4011-942b-06036fda2165" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.318627] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.318773] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.318848] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.318963] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db3246d5-b700-4207-b606-2833b93da8c8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.319111] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.319251] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.319324] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.319435] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21a0bbd4-6f51-4a42-b423-363e65f0247c" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.319557] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.319693] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.319761] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.319872] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e40b8bb2-69f0-406e-b3e0-a2cdc2a7d656" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.319992] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.320151] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.320216] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.320320] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab77afc1-ca2d-4d03-8596-057f87dcdf4e" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.351379] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.351673] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.351673] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.351922] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.352087] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.352237] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb5a0c7c-b375-4d79-8e33-962a90b59498" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.354907] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.355126] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.355126] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.355288] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.355357] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.355479] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8c6b66c-008b-4312-bbb0-7ebb56a6a2d6" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.373247] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.373468] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.373468] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.373642] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.373702] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.373806] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b8bb0e6-1d22-4e95-a649-fc4d3180195b" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.428444] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.428667] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.428667] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.428856] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.428947] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.429088] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-316d910a-b054-4723-942e-7f84e9154008" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.467591] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.467828] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.467828] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.468011] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.468114] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.468230] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6dc57fb-f44d-4b26-87fe-bb8e4df202a8" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.503231] env[65783]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65783) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.503449] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.503449] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.503638] env[65783]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.503729] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.503856] env[65783]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e588ff7c-d45a-4b75-823e-f219eeb5e814" {{(pid=65783) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.215191] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1516.215586] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1521.216551] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1521.216962] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1526.217386] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1526.217793] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1531.219074] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1531.219494] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1536.220639] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1536.220921] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1541.221952] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1541.222379] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1546.222635] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1546.223047] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1551.223959] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1551.224490] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1556.225307] env[65783]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1556.225673] env[65783]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0